Jul 08 18:04:24.617601 ip-10-0-137-15 systemd[1]: Starting Kubernetes Kubelet... Jul 08 18:04:25.028284 ip-10-0-137-15 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 18:04:25.028284 ip-10-0-137-15 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 18:04:25.028284 ip-10-0-137-15 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 18:04:25.028284 ip-10-0-137-15 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 18:04:25.028833 ip-10-0-137-15 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 18:04:25.028833 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.028346 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 18:04:25.034611 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034598 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:04:25.034611 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034612 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:04:25.034674 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034616 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:04:25.034674 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034620 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:04:25.034674 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034623 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:04:25.034674 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034626 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:04:25.034674 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034629 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:04:25.034674 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034632 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:04:25.034674 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034635 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:04:25.034674 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034638 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:04:25.034674 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034645 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:04:25.034674 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034648 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:04:25.034674 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034651 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:04:25.034674 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034653 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:04:25.034674 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034656 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:04:25.034674 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034658 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:04:25.034674 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034661 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:04:25.034674 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034663 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:04:25.034674 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034666 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:04:25.034674 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034669 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:04:25.034674 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034671 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:04:25.034674 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034674 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:04:25.035199 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034677 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:04:25.035199 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034679 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:04:25.035199 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034682 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:04:25.035199 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034685 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:04:25.035199 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034688 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:04:25.035199 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034691 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:04:25.035199 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034693 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:04:25.035199 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034697 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:04:25.035199 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034699 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:04:25.035199 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034703 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:04:25.035199 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034707 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:04:25.035199 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034710 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:04:25.035199 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034713 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:04:25.035199 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034715 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:04:25.035199 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034718 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:04:25.035199 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034720 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:04:25.035199 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034722 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:04:25.035199 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034725 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:04:25.035199 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034728 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:04:25.035659 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034731 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:04:25.035659 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034735 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:04:25.035659 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034737 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:04:25.035659 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034740 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:04:25.035659 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034743 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:04:25.035659 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034745 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:04:25.035659 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034748 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:04:25.035659 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034750 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:04:25.035659 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034753 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:04:25.035659 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034755 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:04:25.035659 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034758 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:04:25.035659 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034760 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:04:25.035659 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034763 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:04:25.035659 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034766 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:04:25.035659 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034768 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:04:25.035659 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034771 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:04:25.035659 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034773 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:04:25.035659 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034776 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:04:25.035659 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034778 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:04:25.036150 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034783 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:04:25.036150 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034786 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:04:25.036150 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034789 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:04:25.036150 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034792 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:04:25.036150 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034800 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:04:25.036150 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034803 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:04:25.036150 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034806 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:04:25.036150 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034808 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:04:25.036150 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034811 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:04:25.036150 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034813 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:04:25.036150 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034816 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:04:25.036150 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034818 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:04:25.036150 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034821 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:04:25.036150 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034823 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:04:25.036150 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034826 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:04:25.036150 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034828 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:04:25.036150 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034830 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:04:25.036150 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034833 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:04:25.036150 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034835 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:04:25.036607 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034838 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:04:25.036607 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034840 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:04:25.036607 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034843 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:04:25.036607 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034845 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:04:25.036607 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034848 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:04:25.036607 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034850 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:04:25.036607 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034853 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:04:25.036607 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034862 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:04:25.036607 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034865 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:04:25.036607 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034867 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:04:25.036607 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034870 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:04:25.036607 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034872 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:04:25.036607 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034875 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:04:25.036607 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034877 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:04:25.036607 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034880 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:04:25.036607 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034882 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:04:25.036607 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034884 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:04:25.036607 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034887 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:04:25.036607 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034895 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:04:25.036607 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.034897 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:04:25.037120 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036568 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:04:25.037120 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036575 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:04:25.037120 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036578 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:04:25.037120 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036581 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:04:25.037120 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036584 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:04:25.037120 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036586 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:04:25.037120 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036589 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:04:25.037120 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036592 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:04:25.037120 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036594 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:04:25.037120 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036597 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:04:25.037120 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036599 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:04:25.037120 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036602 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:04:25.037120 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036604 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:04:25.037120 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036607 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:04:25.037120 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036609 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:04:25.037120 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036612 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:04:25.037120 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036615 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:04:25.037120 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036619 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:04:25.037120 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036622 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:04:25.037120 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036624 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:04:25.037613 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036627 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:04:25.037613 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036631 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:04:25.037613 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036634 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:04:25.037613 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036638 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:04:25.037613 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036641 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:04:25.037613 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036644 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:04:25.037613 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036647 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:04:25.037613 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036650 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:04:25.037613 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036652 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:04:25.037613 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036655 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:04:25.037613 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036657 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:04:25.037613 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036660 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:04:25.037613 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036662 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:04:25.037613 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036666 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:04:25.037613 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036670 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:04:25.037613 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036672 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:04:25.037613 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036675 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:04:25.037613 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036678 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:04:25.037613 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036680 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:04:25.038110 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036683 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:04:25.038110 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036686 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:04:25.038110 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036689 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:04:25.038110 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036691 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:04:25.038110 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036694 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:04:25.038110 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036696 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:04:25.038110 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036699 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:04:25.038110 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036701 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:04:25.038110 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036704 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:04:25.038110 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036706 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:04:25.038110 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036708 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:04:25.038110 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036712 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:04:25.038110 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036716 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:04:25.038110 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036718 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:04:25.038110 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036721 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:04:25.038110 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036724 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:04:25.038110 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036726 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:04:25.038110 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036729 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:04:25.038110 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036731 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:04:25.038572 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036733 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:04:25.038572 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036736 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:04:25.038572 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036738 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:04:25.038572 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036741 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:04:25.038572 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036743 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:04:25.038572 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036746 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:04:25.038572 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036749 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:04:25.038572 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036751 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:04:25.038572 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036754 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:04:25.038572 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036757 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:04:25.038572 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036759 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:04:25.038572 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036762 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:04:25.038572 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036764 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:04:25.038572 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036767 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:04:25.038572 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036769 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:04:25.038572 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036772 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:04:25.038572 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036774 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:04:25.038572 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036776 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:04:25.038572 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036779 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:04:25.038572 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036781 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:04:25.039050 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036784 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:04:25.039050 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036786 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:04:25.039050 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036789 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:04:25.039050 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036792 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:04:25.039050 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036795 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:04:25.039050 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036797 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:04:25.039050 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036800 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:04:25.039050 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036802 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:04:25.039050 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036806 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:04:25.039050 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036809 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:04:25.039050 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036812 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:04:25.039050 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036814 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:04:25.039050 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036817 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:04:25.039050 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036819 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:04:25.039050 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036821 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:04:25.039050 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036824 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:04:25.039050 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036826 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:04:25.039050 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036829 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:04:25.039050 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036831 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:04:25.039050 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036836 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:04:25.039567 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.036838 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:04:25.039567 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037179 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:04:25.039567 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037184 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:04:25.039567 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037187 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:04:25.039567 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037190 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:04:25.039567 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037192 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:04:25.039567 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037195 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:04:25.039567 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037197 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:04:25.039567 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037200 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:04:25.039567 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037203 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:04:25.039567 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037207 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:04:25.039567 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037210 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:04:25.039567 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037213 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:04:25.039567 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037216 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:04:25.039567 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037219 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:04:25.039567 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037222 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:04:25.039567 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037224 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:04:25.039567 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037227 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:04:25.039567 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037229 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:04:25.039567 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037232 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:04:25.040038 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037235 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:04:25.040038 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037237 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:04:25.040038 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037240 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:04:25.040038 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037242 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:04:25.040038 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037245 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:04:25.040038 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037248 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:04:25.040038 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037251 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:04:25.040038 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037253 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:04:25.040038 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037256 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:04:25.040038 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037258 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:04:25.040038 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037261 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:04:25.040038 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037265 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:04:25.040038 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037267 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:04:25.040038 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037271 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:04:25.040038 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037275 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:04:25.040038 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037277 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:04:25.040038 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037280 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:04:25.040038 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037283 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:04:25.040038 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037286 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:04:25.040038 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037288 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:04:25.040531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037290 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:04:25.040531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037293 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:04:25.040531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037296 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:04:25.040531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037298 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:04:25.040531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037301 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:04:25.040531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037303 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:04:25.040531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037306 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:04:25.040531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037309 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:04:25.040531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037311 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:04:25.040531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037314 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:04:25.040531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037317 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:04:25.040531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037319 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:04:25.040531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037322 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:04:25.040531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037324 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:04:25.040531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037326 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:04:25.040531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037330 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:04:25.040531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037333 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:04:25.040531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037337 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:04:25.040531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037339 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:04:25.040985 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037342 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:04:25.040985 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037345 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:04:25.040985 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037348 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:04:25.040985 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037350 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:04:25.040985 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037353 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:04:25.040985 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037356 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:04:25.040985 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037358 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:04:25.040985 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037361 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:04:25.040985 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037363 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:04:25.040985 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037366 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:04:25.040985 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037368 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:04:25.040985 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037372 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:04:25.040985 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037374 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:04:25.040985 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037376 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:04:25.040985 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037379 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:04:25.040985 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037382 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:04:25.040985 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037384 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:04:25.040985 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037387 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:04:25.040985 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037389 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037392 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037394 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037397 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037399 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037401 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037404 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037406 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037409 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037411 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037414 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037416 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037419 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037421 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037423 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037426 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037432 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037434 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037437 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037440 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037448 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:04:25.041444 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037451 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.037453 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037518 2574 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037524 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037530 2574 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037534 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037538 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037541 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037545 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037548 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037551 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037554 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037557 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037560 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037563 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037566 2574 flags.go:64] FLAG: --cgroup-root="" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037568 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037571 2574 flags.go:64] FLAG: --client-ca-file="" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037574 2574 flags.go:64] FLAG: --cloud-provider="external" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037577 2574 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037580 2574 flags.go:64] FLAG: --cluster-domain="" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037583 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037587 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037590 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 18:04:25.041936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037593 2574 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037596 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037599 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037603 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037606 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037609 2574 flags.go:64] FLAG: --contention-profiling="false" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037611 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037614 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037618 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037621 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037625 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037628 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037631 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037633 2574 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037636 2574 flags.go:64] FLAG: --enable-server="true" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037639 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037643 2574 flags.go:64] FLAG: --event-burst="100" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037646 2574 flags.go:64] FLAG: --event-qps="50" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037649 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037651 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037654 2574 flags.go:64] FLAG: --eviction-hard="" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037657 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037660 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037663 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037665 2574 flags.go:64] FLAG: --eviction-soft="" Jul 08 18:04:25.042620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037668 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037671 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037673 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037676 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037679 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037682 2574 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037685 2574 flags.go:64] FLAG: --feature-gates="" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037688 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037691 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037694 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037699 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037701 2574 flags.go:64] FLAG: --healthz-port="10248" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037704 2574 flags.go:64] FLAG: --help="false" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037707 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-137-15.ec2.internal" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037710 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037713 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037716 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037719 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037723 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037726 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037728 2574 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037731 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037733 2574 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 18:04:25.043235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037736 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037739 2574 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037742 2574 flags.go:64] FLAG: --kube-reserved="" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037745 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037747 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037750 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037752 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037755 2574 flags.go:64] FLAG: --lock-file="" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037758 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037760 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037763 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037768 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037770 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037773 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037776 2574 flags.go:64] FLAG: --logging-format="text" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037778 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037782 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037784 2574 flags.go:64] FLAG: --manifest-url="" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037787 2574 flags.go:64] FLAG: --manifest-url-header="" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037792 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037795 2574 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037798 2574 flags.go:64] FLAG: --max-pods="110" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037801 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037804 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037807 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 18:04:25.043846 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037809 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037813 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037815 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037818 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037824 2574 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037827 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037830 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037832 2574 flags.go:64] FLAG: --pod-cidr="" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037835 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037840 2574 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037843 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037846 2574 flags.go:64] FLAG: --pods-per-core="0" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037849 2574 flags.go:64] FLAG: --port="10250" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037852 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037854 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-040e1a6e88dfe14df" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037857 2574 flags.go:64] FLAG: --qos-reserved="" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037860 2574 flags.go:64] FLAG: --read-only-port="10255" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037863 2574 flags.go:64] FLAG: --register-node="true" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037865 2574 flags.go:64] FLAG: --register-with-taints="" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037869 2574 flags.go:64] FLAG: --registry-burst="10" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037871 2574 flags.go:64] FLAG: --registry-qps="5" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037874 2574 flags.go:64] FLAG: --reserved-cpus="" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037877 2574 flags.go:64] FLAG: --reserved-memory="" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037880 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037883 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 18:04:25.044792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037886 2574 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037888 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037893 2574 flags.go:64] FLAG: --runonce="false" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037896 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037899 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037902 2574 flags.go:64] FLAG: --seccomp-default="false" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037905 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037907 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037910 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037913 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037916 2574 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037919 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037921 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037924 2574 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037927 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037930 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037932 2574 flags.go:64] FLAG: --system-cgroups="" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037935 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037940 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037943 2574 flags.go:64] FLAG: --tls-cert-file="" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037945 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037949 2574 flags.go:64] FLAG: --tls-min-version="" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037951 2574 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037954 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037957 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 18:04:25.045574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037960 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037962 2574 flags.go:64] FLAG: --v="2" Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037966 2574 flags.go:64] FLAG: --version="false" Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037970 2574 flags.go:64] FLAG: --vmodule="" Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037973 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.037976 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038074 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038077 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038080 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038084 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038086 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038089 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038105 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038108 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038110 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038113 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038116 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038119 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038121 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038124 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038127 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:04:25.046184 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038129 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:04:25.046700 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038132 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:04:25.046700 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038135 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:04:25.046700 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038137 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:04:25.046700 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038141 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:04:25.046700 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038145 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:04:25.046700 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038147 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:04:25.046700 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038150 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:04:25.046700 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038153 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:04:25.046700 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038155 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:04:25.046700 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038157 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:04:25.046700 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038160 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:04:25.046700 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038163 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:04:25.046700 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038165 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:04:25.046700 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038169 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:04:25.046700 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038172 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:04:25.046700 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038174 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:04:25.046700 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038177 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:04:25.046700 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038179 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:04:25.046700 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038182 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:04:25.047180 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038186 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:04:25.047180 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038188 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:04:25.047180 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038190 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:04:25.047180 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038193 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:04:25.047180 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038196 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:04:25.047180 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038198 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:04:25.047180 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038201 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:04:25.047180 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038203 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:04:25.047180 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038206 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:04:25.047180 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038209 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:04:25.047180 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038212 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:04:25.047180 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038214 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:04:25.047180 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038216 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:04:25.047180 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038219 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:04:25.047180 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038222 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:04:25.047180 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038224 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:04:25.047180 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038227 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:04:25.047180 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038229 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:04:25.047180 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038231 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:04:25.047180 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038234 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:04:25.047699 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038236 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:04:25.047699 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038239 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:04:25.047699 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038241 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:04:25.047699 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038244 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:04:25.047699 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038246 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:04:25.047699 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038249 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:04:25.047699 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038252 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:04:25.047699 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038255 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:04:25.047699 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038257 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:04:25.047699 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038260 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:04:25.047699 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038264 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:04:25.047699 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038267 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:04:25.047699 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038271 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:04:25.047699 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038273 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:04:25.047699 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038276 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:04:25.047699 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038278 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:04:25.047699 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038281 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:04:25.047699 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038284 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:04:25.047699 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038286 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:04:25.048214 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038290 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:04:25.048214 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038293 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:04:25.048214 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038295 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:04:25.048214 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038299 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:04:25.048214 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038301 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:04:25.048214 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038304 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:04:25.048214 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038306 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:04:25.048214 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038309 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:04:25.048214 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038312 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:04:25.048214 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038314 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:04:25.048214 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038316 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:04:25.048214 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038319 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:04:25.048214 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038321 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:04:25.048214 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038324 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:04:25.048214 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038326 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:04:25.048214 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038330 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:04:25.048214 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038332 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:04:25.048214 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038335 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:04:25.048214 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038337 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:04:25.048214 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038341 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:04:25.048685 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038344 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:04:25.048685 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038346 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:04:25.048685 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038349 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:04:25.048685 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038351 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:04:25.048685 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.038353 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:04:25.048685 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.038363 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 18:04:25.048685 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.045832 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 18:04:25.048685 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.045845 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 18:04:25.048685 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.045863 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 18:04:25.048685 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.045871 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 18:04:25.048685 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045925 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:04:25.048685 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045930 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:04:25.048685 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045934 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:04:25.048685 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045937 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:04:25.048685 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045940 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:04:25.049065 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045942 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:04:25.049065 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045946 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:04:25.049065 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045950 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:04:25.049065 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045953 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:04:25.049065 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045957 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:04:25.049065 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045959 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:04:25.049065 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045962 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:04:25.049065 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045965 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:04:25.049065 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045968 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:04:25.049065 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045970 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:04:25.049065 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045973 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:04:25.049065 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045975 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:04:25.049065 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045978 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:04:25.049065 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045980 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:04:25.049065 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045983 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:04:25.049065 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045985 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:04:25.049065 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045988 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:04:25.049065 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045990 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:04:25.049065 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045993 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:04:25.049065 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.045996 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:04:25.049582 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046003 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:04:25.049582 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046006 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:04:25.049582 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046008 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:04:25.049582 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046011 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:04:25.049582 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046014 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:04:25.049582 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046017 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:04:25.049582 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046019 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:04:25.049582 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046022 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:04:25.049582 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046024 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:04:25.049582 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046027 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:04:25.049582 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046030 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:04:25.049582 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046032 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:04:25.049582 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046035 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:04:25.049582 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046037 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:04:25.049582 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046040 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:04:25.049582 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046042 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:04:25.049582 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046045 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:04:25.049582 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046048 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:04:25.049582 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046051 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:04:25.049582 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046054 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:04:25.050068 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046056 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:04:25.050068 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046059 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:04:25.050068 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046061 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:04:25.050068 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046064 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:04:25.050068 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046068 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:04:25.050068 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046071 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:04:25.050068 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046074 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:04:25.050068 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046077 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:04:25.050068 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046080 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:04:25.050068 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046083 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:04:25.050068 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046085 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:04:25.050068 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046088 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:04:25.050068 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046103 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:04:25.050068 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046106 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:04:25.050068 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046108 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:04:25.050068 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046111 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:04:25.050068 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046114 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:04:25.050068 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046117 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:04:25.050068 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046120 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:04:25.050531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046122 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:04:25.050531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046125 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:04:25.050531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046127 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:04:25.050531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046130 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:04:25.050531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046132 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:04:25.050531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046135 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:04:25.050531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046138 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:04:25.050531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046140 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:04:25.050531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046143 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:04:25.050531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046145 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:04:25.050531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046148 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:04:25.050531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046151 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:04:25.050531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046153 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:04:25.050531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046155 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:04:25.050531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046158 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:04:25.050531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046161 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:04:25.050531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046163 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:04:25.050531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046166 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:04:25.050531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046168 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:04:25.050531 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046171 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:04:25.050998 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046175 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:04:25.050998 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046179 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:04:25.050998 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046182 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:04:25.050998 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046185 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:04:25.050998 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046188 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:04:25.050998 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046191 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:04:25.050998 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046194 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:04:25.050998 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046197 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:04:25.050998 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046199 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:04:25.050998 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046202 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:04:25.050998 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046205 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:04:25.050998 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046207 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:04:25.050998 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046210 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:04:25.050998 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046213 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:04:25.050998 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046215 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:04:25.051386 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.046220 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 18:04:25.051386 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046338 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:04:25.051386 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046344 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:04:25.051386 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046346 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:04:25.051386 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046349 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:04:25.051386 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046352 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:04:25.051386 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046356 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:04:25.051386 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046358 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:04:25.051386 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046361 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:04:25.051386 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046363 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:04:25.051386 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046366 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:04:25.051386 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046369 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:04:25.051386 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046373 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:04:25.051386 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046377 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:04:25.051753 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046380 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:04:25.051753 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046383 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:04:25.051753 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046385 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:04:25.051753 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046388 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:04:25.051753 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046391 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:04:25.051753 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046393 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:04:25.051753 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046395 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:04:25.051753 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046400 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:04:25.051753 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046403 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:04:25.051753 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046406 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:04:25.051753 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046409 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:04:25.051753 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046412 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:04:25.051753 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046414 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:04:25.051753 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046418 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:04:25.051753 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046422 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:04:25.051753 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046424 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:04:25.051753 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046427 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:04:25.051753 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046430 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:04:25.051753 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046433 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046435 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046438 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046441 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046444 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046446 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046449 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046452 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046455 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046457 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046459 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046462 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046465 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046467 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046470 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046473 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046475 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046478 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046480 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046483 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046486 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:04:25.052309 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046488 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:04:25.052984 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046490 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:04:25.052984 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046493 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:04:25.052984 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046496 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:04:25.052984 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046498 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:04:25.052984 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046501 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:04:25.052984 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046503 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:04:25.052984 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046506 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:04:25.052984 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046508 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:04:25.052984 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046511 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:04:25.052984 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046513 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:04:25.052984 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046516 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:04:25.052984 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046518 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:04:25.052984 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046520 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:04:25.052984 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046523 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:04:25.052984 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046525 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:04:25.052984 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046528 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:04:25.052984 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046531 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:04:25.052984 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046533 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:04:25.052984 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046536 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:04:25.052984 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046538 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:04:25.053762 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046541 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:04:25.053762 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046543 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:04:25.053762 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046546 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:04:25.053762 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046548 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:04:25.053762 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046551 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:04:25.053762 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046557 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:04:25.053762 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046559 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:04:25.053762 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046562 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:04:25.053762 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046564 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:04:25.053762 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046567 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:04:25.053762 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046569 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:04:25.053762 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046571 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:04:25.053762 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046574 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:04:25.053762 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046577 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:04:25.053762 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046579 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:04:25.053762 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046581 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:04:25.053762 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046584 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:04:25.053762 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046586 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:04:25.053762 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046589 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:04:25.053762 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046591 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:04:25.054335 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046594 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:04:25.054335 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046596 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:04:25.054335 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046599 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:04:25.054335 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046601 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:04:25.054335 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046604 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:04:25.054335 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:25.046606 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:04:25.054335 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.046611 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 18:04:25.054335 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.046754 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 18:04:25.054335 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.048894 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 18:04:25.054335 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.051629 2574 server.go:1019] "Starting client certificate rotation" Jul 08 18:04:25.054335 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.051749 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 18:04:25.054335 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.051792 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 18:04:25.054335 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.054042 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 18:04:25.058139 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.058113 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 18:04:25.068486 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.068466 2574 log.go:25] "Validated CRI v1 runtime API" Jul 08 18:04:25.070881 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.070864 2574 log.go:25] "Validated CRI v1 image API" Jul 08 18:04:25.071709 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.071694 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 18:04:25.076797 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.076780 2574 fs.go:135] Filesystem UUIDs: map[6ddf6d5a-e6d1-4a5e-b1ad-26310de3e849:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 eea0c684-a9b8-415b-9a91-bc0c48a00eff:/dev/nvme0n1p4] Jul 08 18:04:25.076856 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.076796 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 18:04:25.079212 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.079179 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 18:04:25.081453 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.081354 2574 manager.go:216] Machine: {Timestamp:2026-07-08 18:04:25.080137453 +0000 UTC m=+0.342965063 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3090304 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2719a3a01a5a38ce2571705f3a49b9 SystemUUID:ec2719a3-a01a-5a38-ce25-71705f3a49b9 BootID:ac72732a-dc34-4548-b620-95e64539de05 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a1:38:94:75:79 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a1:38:94:75:79 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:f6:80:c0:ca:c0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 18:04:25.081453 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.081449 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 18:04:25.081558 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.081512 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 18:04:25.084417 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.084398 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 18:04:25.084535 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.084420 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-15.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 18:04:25.085158 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.085148 2574 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 18:04:25.085200 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.085160 2574 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 18:04:25.085200 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.085168 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 18:04:25.085200 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.085181 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 18:04:25.086456 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.086446 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 18:04:25.089365 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.089354 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 08 18:04:25.089594 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.089583 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 18:04:25.089623 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.089612 2574 kubelet.go:486] "Attempting to sync node with API server" Jul 08 18:04:25.089623 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.089622 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 18:04:25.089678 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.089638 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 18:04:25.089678 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.089646 2574 kubelet.go:398] "Adding apiserver pod source" Jul 08 18:04:25.089678 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.089662 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 18:04:25.090109 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.090075 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 18:04:25.090183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.090127 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 18:04:25.094249 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.094232 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 18:04:25.096257 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.096242 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 18:04:25.096312 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.096280 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 18:04:25.097391 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.097379 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 18:04:25.097459 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.097394 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 18:04:25.097459 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.097400 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 18:04:25.097459 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.097406 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 18:04:25.097459 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.097413 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 18:04:25.097459 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.097419 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 18:04:25.097459 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.097427 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 18:04:25.097459 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.097433 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 18:04:25.097459 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.097440 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 18:04:25.097459 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.097445 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 18:04:25.097459 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.097453 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 18:04:25.097459 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.097458 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 18:04:25.098196 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.098184 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 18:04:25.098243 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.098198 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 18:04:25.100223 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.100198 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-15.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 18:04:25.100302 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:25.100203 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-15.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 18:04:25.100302 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:25.100270 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 18:04:25.102204 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.102192 2574 server.go:1268] "Started kubelet" Jul 08 18:04:25.102277 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.102256 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 18:04:25.102417 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.102367 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 18:04:25.102498 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.102440 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 18:04:25.103829 ip-10-0-137-15 systemd[1]: Started Kubernetes Kubelet. Jul 08 18:04:25.104320 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.104038 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 18:04:25.104820 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.104804 2574 server.go:310] "Adding debug handlers to kubelet server" Jul 08 18:04:25.107575 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:25.106652 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-15.ec2.internal.18c06299ca4b5107 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-15.ec2.internal,UID:ip-10-0-137-15.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-15.ec2.internal,},FirstTimestamp:2026-07-08 18:04:25.102168327 +0000 UTC m=+0.364995915,LastTimestamp:2026-07-08 18:04:25.102168327 +0000 UTC m=+0.364995915,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-15.ec2.internal,}" Jul 08 18:04:25.108731 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:25.108555 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 18:04:25.110938 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.110922 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5vv7m" Jul 08 18:04:25.111325 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.111299 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 18:04:25.111394 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.111311 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 18:04:25.111452 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:25.111417 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-15.ec2.internal\" not found" Jul 08 18:04:25.112133 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.112114 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 18:04:25.112133 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.112116 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 18:04:25.112268 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.112146 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 18:04:25.112362 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.112268 2574 reconstruct.go:97] "Volume reconstruction finished" Jul 08 18:04:25.112362 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.112276 2574 reconciler.go:29] "Reconciler: start to sync state" Jul 08 18:04:25.112362 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.112334 2574 factory.go:55] Registering systemd factory Jul 08 18:04:25.112362 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.112350 2574 factory.go:223] Registration of the systemd container factory successfully Jul 08 18:04:25.112609 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.112563 2574 factory.go:153] Registering CRI-O factory Jul 08 18:04:25.112609 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.112574 2574 factory.go:223] Registration of the crio container factory successfully Jul 08 18:04:25.112698 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.112613 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 18:04:25.112698 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.112629 2574 factory.go:103] Registering Raw factory Jul 08 18:04:25.112698 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.112639 2574 manager.go:1196] Started watching for new ooms in manager Jul 08 18:04:25.113014 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.113000 2574 manager.go:349] Starting recovery of all containers Jul 08 18:04:25.116813 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.116794 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5vv7m" Jul 08 18:04:25.122664 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.122586 2574 manager.go:354] Recovery completed Jul 08 18:04:25.123757 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.123736 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:04:25.126905 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:25.126883 2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-15.ec2.internal\" not found" node="ip-10-0-137-15.ec2.internal" Jul 08 18:04:25.128250 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.128238 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:04:25.130237 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.130221 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:04:25.130311 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.130247 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:04:25.130311 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.130256 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:04:25.130753 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.130739 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 18:04:25.130753 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.130752 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 18:04:25.130845 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.130767 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 08 18:04:25.130845 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.130789 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:04:25.131464 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.131448 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:04:25.131523 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.131474 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:04:25.131523 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.131484 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:04:25.131859 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.131846 2574 policy_none.go:49] "None policy: Start" Jul 08 18:04:25.131914 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.131865 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 18:04:25.131914 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.131907 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 18:04:25.132891 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.132879 2574 policy_none.go:47] "Start" Jul 08 18:04:25.177655 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.177643 2574 manager.go:337] "Starting Device Plugin manager" Jul 08 18:04:25.177744 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:25.177676 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 18:04:25.177744 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.177685 2574 server.go:87] "Starting device plugin registration server" Jul 08 18:04:25.177865 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.177853 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 18:04:25.177912 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.177870 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 18:04:25.177966 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.177941 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 18:04:25.178072 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.178047 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 18:04:25.178072 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.178061 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 18:04:25.179280 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:25.179262 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 18:04:25.179364 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:25.179323 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-15.ec2.internal\" not found" Jul 08 18:04:25.244347 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.244327 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 18:04:25.245637 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.245619 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 18:04:25.245706 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.245650 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 18:04:25.245706 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.245667 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 18:04:25.245706 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:25.245701 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 18:04:25.248173 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.248158 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:04:25.278132 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.278113 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:04:25.278950 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.278909 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:04:25.278950 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.278938 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:04:25.279078 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.278953 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:04:25.279078 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.278979 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-15.ec2.internal" Jul 08 18:04:25.289395 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.289380 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-15.ec2.internal" Jul 08 18:04:25.289453 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:25.289399 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-15.ec2.internal\": node \"ip-10-0-137-15.ec2.internal\" not found" Jul 08 18:04:25.302726 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:25.302707 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-15.ec2.internal\" not found" Jul 08 18:04:25.346057 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.346030 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-15.ec2.internal"] Jul 08 18:04:25.346129 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.346109 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:04:25.346827 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.346811 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:04:25.346898 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.346841 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:04:25.346898 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.346854 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:04:25.347974 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.347961 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:04:25.348090 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.348075 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal" Jul 08 18:04:25.348210 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.348127 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:04:25.348648 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.348634 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:04:25.348648 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.348641 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:04:25.348756 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.348657 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:04:25.348756 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.348668 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:04:25.348756 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.348659 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:04:25.348756 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.348754 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:04:25.350001 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.349985 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-15.ec2.internal" Jul 08 18:04:25.350068 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.350018 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:04:25.350705 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.350679 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:04:25.350786 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.350711 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:04:25.350786 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.350725 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:04:25.378610 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:25.378591 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-15.ec2.internal\" not found" node="ip-10-0-137-15.ec2.internal" Jul 08 18:04:25.382936 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:25.382921 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-15.ec2.internal\" not found" node="ip-10-0-137-15.ec2.internal" Jul 08 18:04:25.402938 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:25.402919 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-15.ec2.internal\" not found" Jul 08 18:04:25.413641 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.413619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc962ef72161a4d249d8dfa152df87aa-config\") pod \"kube-apiserver-proxy-ip-10-0-137-15.ec2.internal\" (UID: \"fc962ef72161a4d249d8dfa152df87aa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-15.ec2.internal" Jul 08 18:04:25.413727 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.413643 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b901dfb04e817a9c04cdd81f64423379-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal\" (UID: \"b901dfb04e817a9c04cdd81f64423379\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal" Jul 08 18:04:25.413727 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.413659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b901dfb04e817a9c04cdd81f64423379-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal\" (UID: \"b901dfb04e817a9c04cdd81f64423379\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal" Jul 08 18:04:25.503982 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:25.503961 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-15.ec2.internal\" not found" Jul 08 18:04:25.514329 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.514303 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc962ef72161a4d249d8dfa152df87aa-config\") pod \"kube-apiserver-proxy-ip-10-0-137-15.ec2.internal\" (UID: \"fc962ef72161a4d249d8dfa152df87aa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-15.ec2.internal" Jul 08 18:04:25.514424 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.514338 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b901dfb04e817a9c04cdd81f64423379-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal\" (UID: \"b901dfb04e817a9c04cdd81f64423379\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal" Jul 08 18:04:25.514424 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.514364 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b901dfb04e817a9c04cdd81f64423379-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal\" (UID: \"b901dfb04e817a9c04cdd81f64423379\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal" Jul 08 18:04:25.514424 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.514396 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc962ef72161a4d249d8dfa152df87aa-config\") pod \"kube-apiserver-proxy-ip-10-0-137-15.ec2.internal\" (UID: \"fc962ef72161a4d249d8dfa152df87aa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-15.ec2.internal" Jul 08 18:04:25.514424 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.514413 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b901dfb04e817a9c04cdd81f64423379-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal\" (UID: \"b901dfb04e817a9c04cdd81f64423379\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal" Jul 08 18:04:25.514603 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.514401 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b901dfb04e817a9c04cdd81f64423379-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal\" (UID: \"b901dfb04e817a9c04cdd81f64423379\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal" Jul 08 18:04:25.604730 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:25.604678 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-15.ec2.internal\" not found" Jul 08 18:04:25.681791 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.681767 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal" Jul 08 18:04:25.686042 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:25.685867 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-15.ec2.internal" Jul 08 18:04:25.705610 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:25.705568 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-15.ec2.internal\" not found" Jul 08 18:04:25.805840 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:25.805808 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-15.ec2.internal\" not found" Jul 08 18:04:25.906415 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:25.906361 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-15.ec2.internal\" not found" Jul 08 18:04:26.006871 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:26.006844 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-15.ec2.internal\" not found" Jul 08 18:04:26.049376 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:26.049359 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 18:04:26.049953 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:26.049491 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 18:04:26.049953 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:26.049546 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 18:04:26.104314 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:26.104287 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:04:26.112151 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:26.112124 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal" Jul 08 18:04:26.112246 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:26.112126 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 18:04:26.116520 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:26.116501 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:04:26.118534 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:26.118510 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 17:59:26 +0000 UTC" deadline="2028-03-20 04:09:45.903008206 +0000 UTC" Jul 08 18:04:26.118534 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:26.118534 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14890h5m19.784476936s" Jul 08 18:04:26.122656 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:26.122640 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 18:04:26.124294 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:26.124278 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 18:04:26.125280 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:26.125264 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-15.ec2.internal" Jul 08 18:04:26.134864 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:26.134849 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 18:04:26.143431 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:26.143412 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c862b" Jul 08 18:04:26.152334 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:26.152317 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c862b" Jul 08 18:04:26.502203 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:26.502178 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb901dfb04e817a9c04cdd81f64423379.slice/crio-fc4323fb4c6dcc2b15073975a831f8801f175ae185cb921add0fbf73ca4adb8e WatchSource:0}: Error finding container fc4323fb4c6dcc2b15073975a831f8801f175ae185cb921add0fbf73ca4adb8e: Status 404 returned error can't find the container with id fc4323fb4c6dcc2b15073975a831f8801f175ae185cb921add0fbf73ca4adb8e Jul 08 18:04:26.506661 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:26.506647 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:04:26.618822 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:26.618792 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc962ef72161a4d249d8dfa152df87aa.slice/crio-a285defc23d23fa2c842d6451863c94cdebce832401b4ad6e2d4fbad2a410fa2 WatchSource:0}: Error finding container a285defc23d23fa2c842d6451863c94cdebce832401b4ad6e2d4fbad2a410fa2: Status 404 returned error can't find the container with id a285defc23d23fa2c842d6451863c94cdebce832401b4ad6e2d4fbad2a410fa2 Jul 08 18:04:28.090180 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.090154 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:04:28.110288 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.110261 2574 apiserver.go:52] "Watching apiserver" Jul 08 18:04:28.118593 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.118570 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 18:04:28.118964 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.118939 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal","openshift-multus/multus-7mggs","openshift-multus/multus-additional-cni-plugins-kbs6w","openshift-multus/network-metrics-daemon-qd8c6","openshift-network-operator/iptables-alerter-qlclh","openshift-ovn-kubernetes/ovnkube-node-b9ftw","kube-system/global-pull-secret-syncer-rj4rd","kube-system/konnectivity-agent-ntsb7","kube-system/kube-apiserver-proxy-ip-10-0-137-15.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd","openshift-cluster-node-tuning-operator/tuned-xr57w","openshift-dns/node-resolver-vvdbr","openshift-network-diagnostics/network-check-target-nqpg2","openshift-image-registry/node-ca-jwz48"] Jul 08 18:04:28.120670 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.120650 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:28.120760 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:28.120739 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:04:28.121815 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.121798 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:28.121876 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:28.121851 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:04:28.122904 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.122884 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.124411 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.124391 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:28.124530 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:28.124466 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:04:28.125485 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.125466 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qlclh" Jul 08 18:04:28.126450 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.126411 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ggjgj\"" Jul 08 18:04:28.126450 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.126445 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 18:04:28.126618 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.126499 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 18:04:28.126618 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.126539 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 18:04:28.126618 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.126540 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 18:04:28.126618 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.126450 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 18:04:28.127219 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.127193 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.128452 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.128431 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jwz48" Jul 08 18:04:28.128927 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.128885 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nhwml\"" Jul 08 18:04:28.129199 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.129158 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 18:04:28.129199 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.129164 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 18:04:28.129363 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.129218 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:04:28.129870 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.129847 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 18:04:28.129964 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.129939 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ntsb7" Jul 08 18:04:28.130348 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.130320 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-522dx\"" Jul 08 18:04:28.131318 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.131295 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.132360 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.132332 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 18:04:28.132490 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.132394 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 18:04:28.132584 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.132565 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 18:04:28.132644 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.132584 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 18:04:28.132734 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.132716 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 18:04:28.132789 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.132773 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 18:04:28.132839 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.132777 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 18:04:28.132839 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.132819 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s7lt7\"" Jul 08 18:04:28.132934 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.132861 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 18:04:28.133678 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.133438 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.133678 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.133478 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 18:04:28.133678 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.133514 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 18:04:28.136041 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.135484 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9cst8\"" Jul 08 18:04:28.137115 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.136119 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 18:04:28.137115 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.136180 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-42pt6\"" Jul 08 18:04:28.137115 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.136995 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 18:04:28.137401 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.137376 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 18:04:28.137572 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.137528 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7w4fd\"" Jul 08 18:04:28.137758 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.137737 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 18:04:28.139042 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.138716 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.140272 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140233 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.140372 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140301 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-run-ovn\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.140372 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140333 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f3b0d99-28f8-4f35-a092-5be6eec3c766-cni-binary-copy\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.140372 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140358 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-host-run-multus-certs\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.140657 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140384 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.140657 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140408 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs\") pod \"network-metrics-daemon-qd8c6\" (UID: \"f51e918c-72d1-41ce-bccb-04cf9571f9f8\") " pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:28.140657 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140460 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-etc-openvswitch\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.140657 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140486 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-env-overrides\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.140657 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140510 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-ovnkube-script-lib\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.140657 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140564 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52trf\" (UniqueName: \"kubernetes.io/projected/7f3b0d99-28f8-4f35-a092-5be6eec3c766-kube-api-access-52trf\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.140657 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140590 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-cnibin\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.140657 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140615 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-kubelet\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.140657 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140639 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-log-socket\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.141109 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140665 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-host-var-lib-cni-bin\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.141109 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140689 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-hostroot\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.141109 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140714 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-system-cni-dir\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.141109 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140734 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-os-release\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.141109 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140760 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ac4ecbf-8862-4292-a3cf-40ac2f4c003c-konnectivity-ca\") pod \"konnectivity-agent-ntsb7\" (UID: \"3ac4ecbf-8862-4292-a3cf-40ac2f4c003c\") " pod="kube-system/konnectivity-agent-ntsb7" Jul 08 18:04:28.141109 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140815 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d43bf8f7-16a4-4595-8185-6de3d1880faf-kubelet-config\") pod \"global-pull-secret-syncer-rj4rd\" (UID: \"d43bf8f7-16a4-4595-8185-6de3d1880faf\") " pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:28.141109 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140841 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d43bf8f7-16a4-4595-8185-6de3d1880faf-dbus\") pod \"global-pull-secret-syncer-rj4rd\" (UID: \"d43bf8f7-16a4-4595-8185-6de3d1880faf\") " pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:28.141109 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140892 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tnqr\" (UniqueName: \"kubernetes.io/projected/f51e918c-72d1-41ce-bccb-04cf9571f9f8-kube-api-access-7tnqr\") pod \"network-metrics-daemon-qd8c6\" (UID: \"f51e918c-72d1-41ce-bccb-04cf9571f9f8\") " pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:28.141109 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140945 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-registration-dir\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.141109 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140971 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/176823c4-1003-4325-a3fd-801fedcd0b43-serviceca\") pod \"node-ca-jwz48\" (UID: \"176823c4-1003-4325-a3fd-801fedcd0b43\") " pod="openshift-image-registry/node-ca-jwz48" Jul 08 18:04:28.141109 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.140995 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-host-run-netns\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.141109 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141063 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-multus-conf-dir\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.141109 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141072 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vvdbr" Jul 08 18:04:28.141109 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141098 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.141693 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141127 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.141693 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141163 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-run-openvswitch\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.141693 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141353 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ac4ecbf-8862-4292-a3cf-40ac2f4c003c-agent-certs\") pod \"konnectivity-agent-ntsb7\" (UID: \"3ac4ecbf-8862-4292-a3cf-40ac2f4c003c\") " pod="kube-system/konnectivity-agent-ntsb7" Jul 08 18:04:28.141693 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141401 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret\") pod \"global-pull-secret-syncer-rj4rd\" (UID: \"d43bf8f7-16a4-4595-8185-6de3d1880faf\") " pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:28.141693 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141449 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-multus-cni-dir\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.141693 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141507 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-host-var-lib-kubelet\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.141693 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141549 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/83c8d1e2-db26-42ef-b62b-2b0fc021020a-iptables-alerter-script\") pod \"iptables-alerter-qlclh\" (UID: \"83c8d1e2-db26-42ef-b62b-2b0fc021020a\") " pod="openshift-network-operator/iptables-alerter-qlclh" Jul 08 18:04:28.141693 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141576 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-sys-fs\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.141693 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141598 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-run-systemd\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.141693 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141621 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-node-log\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.141693 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141645 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n65fl\" (UniqueName: \"kubernetes.io/projected/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-kube-api-access-n65fl\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.141693 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141668 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-os-release\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.141693 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141693 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83c8d1e2-db26-42ef-b62b-2b0fc021020a-host-slash\") pod \"iptables-alerter-qlclh\" (UID: \"83c8d1e2-db26-42ef-b62b-2b0fc021020a\") " pod="openshift-network-operator/iptables-alerter-qlclh" Jul 08 18:04:28.142202 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141716 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-slash\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.142202 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141741 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-run-ovn-kubernetes\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.142202 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141764 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-etc-selinux\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.142202 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141808 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-cni-netd\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.142202 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141833 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-etc-kubernetes\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.142202 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141856 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9sj2\" (UniqueName: \"kubernetes.io/projected/83c8d1e2-db26-42ef-b62b-2b0fc021020a-kube-api-access-g9sj2\") pod \"iptables-alerter-qlclh\" (UID: \"83c8d1e2-db26-42ef-b62b-2b0fc021020a\") " pod="openshift-network-operator/iptables-alerter-qlclh" Jul 08 18:04:28.142202 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141881 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl58q\" (UniqueName: \"kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q\") pod \"network-check-target-nqpg2\" (UID: \"ab615a98-2754-4748-8f58-fbfecce973bd\") " pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:28.142202 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141904 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-cni-binary-copy\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.142202 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141934 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7tdb\" (UniqueName: \"kubernetes.io/projected/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-kube-api-access-c7tdb\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.142202 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.141969 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-var-lib-openvswitch\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.142202 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.142008 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzlfm\" (UniqueName: \"kubernetes.io/projected/176823c4-1003-4325-a3fd-801fedcd0b43-kube-api-access-wzlfm\") pod \"node-ca-jwz48\" (UID: \"176823c4-1003-4325-a3fd-801fedcd0b43\") " pod="openshift-image-registry/node-ca-jwz48" Jul 08 18:04:28.142202 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.142101 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7f3b0d99-28f8-4f35-a092-5be6eec3c766-multus-daemon-config\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.142202 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.142139 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq5r2\" (UniqueName: \"kubernetes.io/projected/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-kube-api-access-jq5r2\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.142202 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.142158 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-run-netns\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.142202 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.142187 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-cni-bin\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.142662 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.142234 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-ovnkube-config\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.142662 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.142297 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-host-run-k8s-cni-cncf-io\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.142662 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.142321 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-device-dir\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.142662 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.142339 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 18:04:28.142662 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.142344 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-systemd-units\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.142662 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.142368 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fsr2l\"" Jul 08 18:04:28.142662 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.142369 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/176823c4-1003-4325-a3fd-801fedcd0b43-host\") pod \"node-ca-jwz48\" (UID: \"176823c4-1003-4325-a3fd-801fedcd0b43\") " pod="openshift-image-registry/node-ca-jwz48" Jul 08 18:04:28.142662 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.142412 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-system-cni-dir\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.142662 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.142435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-cnibin\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.142662 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.142457 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-socket-dir\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.142662 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.142482 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.142662 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.142505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-ovn-node-metrics-cert\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.142662 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.142530 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-multus-socket-dir-parent\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.142662 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.142553 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-host-var-lib-cni-multus\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.144842 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.144821 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:04:28.146294 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.146276 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bxd82\"" Jul 08 18:04:28.146417 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.146283 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 18:04:28.146417 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.146342 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 18:04:28.173099 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.173060 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 17:59:27 +0000 UTC" deadline="2028-04-11 06:41:18.134879856 +0000 UTC" Jul 08 18:04:28.173099 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.173095 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15420h36m49.961787613s" Jul 08 18:04:28.231869 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.231843 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 18:04:28.243180 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243160 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret\") pod \"global-pull-secret-syncer-rj4rd\" (UID: \"d43bf8f7-16a4-4595-8185-6de3d1880faf\") " pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:28.243285 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243188 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-host\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.243285 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243213 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-multus-cni-dir\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.243285 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243247 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-host-var-lib-kubelet\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.243427 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243268 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/83c8d1e2-db26-42ef-b62b-2b0fc021020a-iptables-alerter-script\") pod \"iptables-alerter-qlclh\" (UID: \"83c8d1e2-db26-42ef-b62b-2b0fc021020a\") " pod="openshift-network-operator/iptables-alerter-qlclh" Jul 08 18:04:28.243427 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:28.243317 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:04:28.243427 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243347 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-multus-cni-dir\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.243427 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243365 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-host-var-lib-kubelet\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.243427 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:28.243385 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret podName:d43bf8f7-16a4-4595-8185-6de3d1880faf nodeName:}" failed. No retries permitted until 2026-07-08 18:04:28.743352495 +0000 UTC m=+2.987250644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret") pod "global-pull-secret-syncer-rj4rd" (UID: "d43bf8f7-16a4-4595-8185-6de3d1880faf") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:04:28.243427 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243318 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-sys-fs\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.243427 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243422 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-sys-fs\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.243711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243423 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-sysconfig\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.243711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243464 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e-tmp-dir\") pod \"node-resolver-vvdbr\" (UID: \"545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e\") " pod="openshift-dns/node-resolver-vvdbr" Jul 08 18:04:28.243711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243491 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-run-systemd\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.243711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-node-log\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.243711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243541 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n65fl\" (UniqueName: \"kubernetes.io/projected/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-kube-api-access-n65fl\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.243711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243559 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-run-systemd\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.243711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243564 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-os-release\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.243711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243594 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83c8d1e2-db26-42ef-b62b-2b0fc021020a-host-slash\") pod \"iptables-alerter-qlclh\" (UID: \"83c8d1e2-db26-42ef-b62b-2b0fc021020a\") " pod="openshift-network-operator/iptables-alerter-qlclh" Jul 08 18:04:28.243711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243614 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-os-release\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.243711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243620 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-sysctl-conf\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.243711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243636 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-node-log\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.243711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243644 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-slash\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.243711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243675 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-run-ovn-kubernetes\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.243711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243668 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83c8d1e2-db26-42ef-b62b-2b0fc021020a-host-slash\") pod \"iptables-alerter-qlclh\" (UID: \"83c8d1e2-db26-42ef-b62b-2b0fc021020a\") " pod="openshift-network-operator/iptables-alerter-qlclh" Jul 08 18:04:28.243711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243701 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-etc-selinux\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.243711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243707 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-slash\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.244468 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243727 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-run-ovn-kubernetes\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.244468 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243728 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e-hosts-file\") pod \"node-resolver-vvdbr\" (UID: \"545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e\") " pod="openshift-dns/node-resolver-vvdbr" Jul 08 18:04:28.244468 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243760 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-cni-netd\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.244468 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243801 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-etc-kubernetes\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.244468 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243805 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-etc-selinux\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.244468 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243816 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9sj2\" (UniqueName: \"kubernetes.io/projected/83c8d1e2-db26-42ef-b62b-2b0fc021020a-kube-api-access-g9sj2\") pod \"iptables-alerter-qlclh\" (UID: \"83c8d1e2-db26-42ef-b62b-2b0fc021020a\") " pod="openshift-network-operator/iptables-alerter-qlclh" Jul 08 18:04:28.244468 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243831 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl58q\" (UniqueName: \"kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q\") pod \"network-check-target-nqpg2\" (UID: \"ab615a98-2754-4748-8f58-fbfecce973bd\") " pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:28.244468 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243857 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-cni-netd\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.244468 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243874 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-cni-binary-copy\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.244468 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243884 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-etc-kubernetes\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.244468 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243891 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7tdb\" (UniqueName: \"kubernetes.io/projected/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-kube-api-access-c7tdb\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.244468 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243895 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/83c8d1e2-db26-42ef-b62b-2b0fc021020a-iptables-alerter-script\") pod \"iptables-alerter-qlclh\" (UID: \"83c8d1e2-db26-42ef-b62b-2b0fc021020a\") " pod="openshift-network-operator/iptables-alerter-qlclh" Jul 08 18:04:28.244468 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243953 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-var-lib-openvswitch\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.244468 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.243983 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzlfm\" (UniqueName: \"kubernetes.io/projected/176823c4-1003-4325-a3fd-801fedcd0b43-kube-api-access-wzlfm\") pod \"node-ca-jwz48\" (UID: \"176823c4-1003-4325-a3fd-801fedcd0b43\") " pod="openshift-image-registry/node-ca-jwz48" Jul 08 18:04:28.244468 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244008 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7f3b0d99-28f8-4f35-a092-5be6eec3c766-multus-daemon-config\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.244468 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244053 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq5r2\" (UniqueName: \"kubernetes.io/projected/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-kube-api-access-jq5r2\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.244468 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244076 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-run-netns\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.245278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244101 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-cni-bin\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.245278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244122 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-ovnkube-config\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.245278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244054 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-var-lib-openvswitch\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.245278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244146 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-host-run-k8s-cni-cncf-io\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.245278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244194 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-host-run-k8s-cni-cncf-io\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.245278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244195 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-run-netns\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.245278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244224 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-cni-bin\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.245278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244333 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-cni-binary-copy\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.245278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244339 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-device-dir\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.245278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244396 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-device-dir\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.245278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244396 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-systemd-units\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.245278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244423 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/176823c4-1003-4325-a3fd-801fedcd0b43-host\") pod \"node-ca-jwz48\" (UID: \"176823c4-1003-4325-a3fd-801fedcd0b43\") " pod="openshift-image-registry/node-ca-jwz48" Jul 08 18:04:28.245278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244469 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/176823c4-1003-4325-a3fd-801fedcd0b43-host\") pod \"node-ca-jwz48\" (UID: \"176823c4-1003-4325-a3fd-801fedcd0b43\") " pod="openshift-image-registry/node-ca-jwz48" Jul 08 18:04:28.245278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244468 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-systemd-units\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.245278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244488 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-system-cni-dir\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.245278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244517 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-cnibin\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.245278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244528 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-system-cni-dir\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.245278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244541 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-socket-dir\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.246191 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.246191 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244558 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7f3b0d99-28f8-4f35-a092-5be6eec3c766-multus-daemon-config\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.246191 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244577 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-cnibin\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.246191 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244610 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-sys\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.246191 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244649 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-ovn-node-metrics-cert\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.246191 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244673 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-multus-socket-dir-parent\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.246191 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244697 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-host-var-lib-cni-multus\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.246191 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244718 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-socket-dir\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.246191 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244722 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.246191 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244731 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-ovnkube-config\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.246191 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244746 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-lib-modules\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.246191 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244771 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-var-lib-kubelet\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.246191 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244788 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-multus-socket-dir-parent\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.246191 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244794 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-run-ovn\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.246191 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244812 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-host-var-lib-cni-multus\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.246191 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244820 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f3b0d99-28f8-4f35-a092-5be6eec3c766-cni-binary-copy\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.246191 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244744 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.246884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244846 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-host-run-multus-certs\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.246884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244862 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-run-ovn\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.246884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244872 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-sysctl-d\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.246884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244901 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.246884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs\") pod \"network-metrics-daemon-qd8c6\" (UID: \"f51e918c-72d1-41ce-bccb-04cf9571f9f8\") " pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:28.246884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244950 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-kubernetes\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.246884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.244971 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5966f8d7-f706-4fba-a4d4-a6409cece4a6-tmp\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.246884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245002 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-etc-openvswitch\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.246884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245006 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.246884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245018 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 18:04:28.246884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245051 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-env-overrides\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.246884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245069 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-host-run-multus-certs\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.246884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245078 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-ovnkube-script-lib\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.246884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245116 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52trf\" (UniqueName: \"kubernetes.io/projected/7f3b0d99-28f8-4f35-a092-5be6eec3c766-kube-api-access-52trf\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.246884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245139 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-cnibin\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.246884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245161 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-modprobe-d\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.246884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245183 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-systemd\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.247545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245231 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-tuned\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.247545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245261 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-kubelet\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.247545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245286 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-log-socket\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.247545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245274 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f3b0d99-28f8-4f35-a092-5be6eec3c766-cni-binary-copy\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.247545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245308 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-host-var-lib-cni-bin\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.247545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245312 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.247545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245327 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-hostroot\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.247545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245346 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpb6h\" (UniqueName: \"kubernetes.io/projected/545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e-kube-api-access-wpb6h\") pod \"node-resolver-vvdbr\" (UID: \"545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e\") " pod="openshift-dns/node-resolver-vvdbr" Jul 08 18:04:28.247545 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:28.245373 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:04:28.247545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245377 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-system-cni-dir\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.247545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245392 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-os-release\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.247545 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:28.245406 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs podName:f51e918c-72d1-41ce-bccb-04cf9571f9f8 nodeName:}" failed. No retries permitted until 2026-07-08 18:04:28.745394756 +0000 UTC m=+2.989292899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs") pod "network-metrics-daemon-qd8c6" (UID: "f51e918c-72d1-41ce-bccb-04cf9571f9f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:04:28.247545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245433 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ac4ecbf-8862-4292-a3cf-40ac2f4c003c-konnectivity-ca\") pod \"konnectivity-agent-ntsb7\" (UID: \"3ac4ecbf-8862-4292-a3cf-40ac2f4c003c\") " pod="kube-system/konnectivity-agent-ntsb7" Jul 08 18:04:28.247545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245440 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-os-release\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.247545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245459 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d43bf8f7-16a4-4595-8185-6de3d1880faf-kubelet-config\") pod \"global-pull-secret-syncer-rj4rd\" (UID: \"d43bf8f7-16a4-4595-8185-6de3d1880faf\") " pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:28.247545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245476 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d43bf8f7-16a4-4595-8185-6de3d1880faf-dbus\") pod \"global-pull-secret-syncer-rj4rd\" (UID: \"d43bf8f7-16a4-4595-8185-6de3d1880faf\") " pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:28.247545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245493 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tnqr\" (UniqueName: \"kubernetes.io/projected/f51e918c-72d1-41ce-bccb-04cf9571f9f8-kube-api-access-7tnqr\") pod \"network-metrics-daemon-qd8c6\" (UID: \"f51e918c-72d1-41ce-bccb-04cf9571f9f8\") " pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:28.248183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245498 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d43bf8f7-16a4-4595-8185-6de3d1880faf-kubelet-config\") pod \"global-pull-secret-syncer-rj4rd\" (UID: \"d43bf8f7-16a4-4595-8185-6de3d1880faf\") " pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:28.248183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245508 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-registration-dir\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.248183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245553 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-host-var-lib-cni-bin\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.248183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245575 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-hostroot\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.248183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245575 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-log-socket\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.248183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245605 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-system-cni-dir\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.248183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245656 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-cnibin\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.248183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245689 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-run\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.248183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245675 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d43bf8f7-16a4-4595-8185-6de3d1880faf-dbus\") pod \"global-pull-secret-syncer-rj4rd\" (UID: \"d43bf8f7-16a4-4595-8185-6de3d1880faf\") " pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:28.248183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245717 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/176823c4-1003-4325-a3fd-801fedcd0b43-serviceca\") pod \"node-ca-jwz48\" (UID: \"176823c4-1003-4325-a3fd-801fedcd0b43\") " pod="openshift-image-registry/node-ca-jwz48" Jul 08 18:04:28.248183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245764 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-host-run-netns\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.248183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245798 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-multus-conf-dir\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.248183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245827 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-host-run-netns\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.248183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245822 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.248183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245801 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-env-overrides\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.248183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245856 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-ovnkube-script-lib\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.248183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245871 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.248707 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245864 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-etc-openvswitch\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.248707 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245907 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.248707 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245913 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-registration-dir\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.248707 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245929 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmchj\" (UniqueName: \"kubernetes.io/projected/5966f8d7-f706-4fba-a4d4-a6409cece4a6-kube-api-access-tmchj\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.248707 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.245947 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f3b0d99-28f8-4f35-a092-5be6eec3c766-multus-conf-dir\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.248707 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.246081 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-run-openvswitch\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.248707 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.246110 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ac4ecbf-8862-4292-a3cf-40ac2f4c003c-agent-certs\") pod \"konnectivity-agent-ntsb7\" (UID: \"3ac4ecbf-8862-4292-a3cf-40ac2f4c003c\") " pod="kube-system/konnectivity-agent-ntsb7" Jul 08 18:04:28.248707 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.246253 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-run-openvswitch\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.248707 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.246358 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/176823c4-1003-4325-a3fd-801fedcd0b43-serviceca\") pod \"node-ca-jwz48\" (UID: \"176823c4-1003-4325-a3fd-801fedcd0b43\") " pod="openshift-image-registry/node-ca-jwz48" Jul 08 18:04:28.248707 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.246375 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.248707 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.246412 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ac4ecbf-8862-4292-a3cf-40ac2f4c003c-konnectivity-ca\") pod \"konnectivity-agent-ntsb7\" (UID: \"3ac4ecbf-8862-4292-a3cf-40ac2f4c003c\") " pod="kube-system/konnectivity-agent-ntsb7" Jul 08 18:04:28.248707 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.246478 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-host-kubelet\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.248707 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.248458 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-ovn-node-metrics-cert\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.249244 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.248719 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ac4ecbf-8862-4292-a3cf-40ac2f4c003c-agent-certs\") pod \"konnectivity-agent-ntsb7\" (UID: \"3ac4ecbf-8862-4292-a3cf-40ac2f4c003c\") " pod="kube-system/konnectivity-agent-ntsb7" Jul 08 18:04:28.253736 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:28.253718 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:04:28.253736 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:28.253739 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:04:28.253870 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:28.253752 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rl58q for pod openshift-network-diagnostics/network-check-target-nqpg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:04:28.253943 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:28.253917 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q podName:ab615a98-2754-4748-8f58-fbfecce973bd nodeName:}" failed. No retries permitted until 2026-07-08 18:04:28.753886342 +0000 UTC m=+2.997784485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rl58q" (UniqueName: "kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q") pod "network-check-target-nqpg2" (UID: "ab615a98-2754-4748-8f58-fbfecce973bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:04:28.256215 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.256189 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzlfm\" (UniqueName: \"kubernetes.io/projected/176823c4-1003-4325-a3fd-801fedcd0b43-kube-api-access-wzlfm\") pod \"node-ca-jwz48\" (UID: \"176823c4-1003-4325-a3fd-801fedcd0b43\") " pod="openshift-image-registry/node-ca-jwz48" Jul 08 18:04:28.258965 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.256856 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9sj2\" (UniqueName: \"kubernetes.io/projected/83c8d1e2-db26-42ef-b62b-2b0fc021020a-kube-api-access-g9sj2\") pod \"iptables-alerter-qlclh\" (UID: \"83c8d1e2-db26-42ef-b62b-2b0fc021020a\") " pod="openshift-network-operator/iptables-alerter-qlclh" Jul 08 18:04:28.258965 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.257191 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq5r2\" (UniqueName: \"kubernetes.io/projected/83a9282f-204d-4877-b9b2-d5eb9caa7d5e-kube-api-access-jq5r2\") pod \"aws-ebs-csi-driver-node-95brd\" (UID: \"83a9282f-204d-4877-b9b2-d5eb9caa7d5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.259167 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.259144 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n65fl\" (UniqueName: \"kubernetes.io/projected/6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe-kube-api-access-n65fl\") pod \"ovnkube-node-b9ftw\" (UID: \"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.259419 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.259395 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52trf\" (UniqueName: \"kubernetes.io/projected/7f3b0d99-28f8-4f35-a092-5be6eec3c766-kube-api-access-52trf\") pod \"multus-7mggs\" (UID: \"7f3b0d99-28f8-4f35-a092-5be6eec3c766\") " pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.259829 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.259784 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7tdb\" (UniqueName: \"kubernetes.io/projected/8e33d81c-69f4-41eb-8cfc-ca1563123bbb-kube-api-access-c7tdb\") pod \"multus-additional-cni-plugins-kbs6w\" (UID: \"8e33d81c-69f4-41eb-8cfc-ca1563123bbb\") " pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.260314 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.260000 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tnqr\" (UniqueName: \"kubernetes.io/projected/f51e918c-72d1-41ce-bccb-04cf9571f9f8-kube-api-access-7tnqr\") pod \"network-metrics-daemon-qd8c6\" (UID: \"f51e918c-72d1-41ce-bccb-04cf9571f9f8\") " pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:28.268978 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.268851 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-15.ec2.internal" event={"ID":"fc962ef72161a4d249d8dfa152df87aa","Type":"ContainerStarted","Data":"a285defc23d23fa2c842d6451863c94cdebce832401b4ad6e2d4fbad2a410fa2"} Jul 08 18:04:28.270148 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.270127 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal" event={"ID":"b901dfb04e817a9c04cdd81f64423379","Type":"ContainerStarted","Data":"fc4323fb4c6dcc2b15073975a831f8801f175ae185cb921add0fbf73ca4adb8e"} Jul 08 18:04:28.346879 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.346851 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-run\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.346969 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.346886 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmchj\" (UniqueName: \"kubernetes.io/projected/5966f8d7-f706-4fba-a4d4-a6409cece4a6-kube-api-access-tmchj\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.346969 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.346919 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-host\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.346969 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.346946 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-sysconfig\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.346969 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.346949 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-run\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.347171 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.346978 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e-tmp-dir\") pod \"node-resolver-vvdbr\" (UID: \"545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e\") " pod="openshift-dns/node-resolver-vvdbr" Jul 08 18:04:28.347171 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.346999 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-sysctl-conf\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.347171 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347009 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-host\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.347171 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347016 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e-hosts-file\") pod \"node-resolver-vvdbr\" (UID: \"545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e\") " pod="openshift-dns/node-resolver-vvdbr" Jul 08 18:04:28.347171 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347066 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-sysconfig\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.347171 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347105 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e-hosts-file\") pod \"node-resolver-vvdbr\" (UID: \"545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e\") " pod="openshift-dns/node-resolver-vvdbr" Jul 08 18:04:28.347171 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347074 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-sys\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.347171 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347122 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-sys\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.347171 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347154 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-lib-modules\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.347474 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347171 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-sysctl-conf\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.347474 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347182 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-var-lib-kubelet\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.347474 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347216 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-sysctl-d\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.347474 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347226 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-var-lib-kubelet\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.347474 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347261 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-kubernetes\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.347474 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347281 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5966f8d7-f706-4fba-a4d4-a6409cece4a6-tmp\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.347474 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347279 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e-tmp-dir\") pod \"node-resolver-vvdbr\" (UID: \"545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e\") " pod="openshift-dns/node-resolver-vvdbr" Jul 08 18:04:28.347474 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347306 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-lib-modules\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.347474 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347316 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-sysctl-d\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.347474 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347326 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-kubernetes\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.347474 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347331 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-modprobe-d\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.347474 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347350 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-systemd\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.347474 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347364 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-tuned\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.347474 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347384 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpb6h\" (UniqueName: \"kubernetes.io/projected/545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e-kube-api-access-wpb6h\") pod \"node-resolver-vvdbr\" (UID: \"545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e\") " pod="openshift-dns/node-resolver-vvdbr" Jul 08 18:04:28.347474 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347424 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-systemd\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.347474 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.347451 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-modprobe-d\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.349170 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.349155 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5966f8d7-f706-4fba-a4d4-a6409cece4a6-tmp\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.349226 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.349209 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5966f8d7-f706-4fba-a4d4-a6409cece4a6-etc-tuned\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.355948 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.355927 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpb6h\" (UniqueName: \"kubernetes.io/projected/545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e-kube-api-access-wpb6h\") pod \"node-resolver-vvdbr\" (UID: \"545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e\") " pod="openshift-dns/node-resolver-vvdbr" Jul 08 18:04:28.356502 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.356482 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmchj\" (UniqueName: \"kubernetes.io/projected/5966f8d7-f706-4fba-a4d4-a6409cece4a6-kube-api-access-tmchj\") pod \"tuned-xr57w\" (UID: \"5966f8d7-f706-4fba-a4d4-a6409cece4a6\") " pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.437270 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.437243 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kbs6w" Jul 08 18:04:28.444549 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.444529 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qlclh" Jul 08 18:04:28.447796 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:28.447767 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e33d81c_69f4_41eb_8cfc_ca1563123bbb.slice/crio-c05257fda55409f5a71cb0e8c9303c866cc933e71eca155993f9ceafba329a2d WatchSource:0}: Error finding container c05257fda55409f5a71cb0e8c9303c866cc933e71eca155993f9ceafba329a2d: Status 404 returned error can't find the container with id c05257fda55409f5a71cb0e8c9303c866cc933e71eca155993f9ceafba329a2d Jul 08 18:04:28.451853 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.451809 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:28.454201 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:28.454167 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83c8d1e2_db26_42ef_b62b_2b0fc021020a.slice/crio-3c01c1f87f13b5b5c3214fc0fabbcd22f95b50fd96809bf98970091b71f295e0 WatchSource:0}: Error finding container 3c01c1f87f13b5b5c3214fc0fabbcd22f95b50fd96809bf98970091b71f295e0: Status 404 returned error can't find the container with id 3c01c1f87f13b5b5c3214fc0fabbcd22f95b50fd96809bf98970091b71f295e0 Jul 08 18:04:28.457213 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.457194 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jwz48" Jul 08 18:04:28.462194 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.462177 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ntsb7" Jul 08 18:04:28.467342 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.467324 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7mggs" Jul 08 18:04:28.473651 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.473521 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" Jul 08 18:04:28.474469 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:28.474448 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ac4ecbf_8862_4292_a3cf_40ac2f4c003c.slice/crio-5f37230e0cd770fd829da84fb827428174943b32344a8535e8df157568f1c7f6 WatchSource:0}: Error finding container 5f37230e0cd770fd829da84fb827428174943b32344a8535e8df157568f1c7f6: Status 404 returned error can't find the container with id 5f37230e0cd770fd829da84fb827428174943b32344a8535e8df157568f1c7f6 Jul 08 18:04:28.478647 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.478630 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xr57w" Jul 08 18:04:28.480039 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:28.479817 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f3b0d99_28f8_4f35_a092_5be6eec3c766.slice/crio-5c624d38d7d07ba202fb00deb929386297895e3760a117871e291fbea5f33257 WatchSource:0}: Error finding container 5c624d38d7d07ba202fb00deb929386297895e3760a117871e291fbea5f33257: Status 404 returned error can't find the container with id 5c624d38d7d07ba202fb00deb929386297895e3760a117871e291fbea5f33257 Jul 08 18:04:28.482452 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.482436 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vvdbr" Jul 08 18:04:28.483918 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:28.483898 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a9282f_204d_4877_b9b2_d5eb9caa7d5e.slice/crio-09699f48ee6c82de40ffc6b8b63acd0d06a9addf1c1225abb2c589dae5507908 WatchSource:0}: Error finding container 09699f48ee6c82de40ffc6b8b63acd0d06a9addf1c1225abb2c589dae5507908: Status 404 returned error can't find the container with id 09699f48ee6c82de40ffc6b8b63acd0d06a9addf1c1225abb2c589dae5507908 Jul 08 18:04:28.489443 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:28.489413 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5966f8d7_f706_4fba_a4d4_a6409cece4a6.slice/crio-2cec0a9d2a0a1c8d095ab7e0d1f6cf84ee46825957539ad1703117a88e41859d WatchSource:0}: Error finding container 2cec0a9d2a0a1c8d095ab7e0d1f6cf84ee46825957539ad1703117a88e41859d: Status 404 returned error can't find the container with id 2cec0a9d2a0a1c8d095ab7e0d1f6cf84ee46825957539ad1703117a88e41859d Jul 08 18:04:28.492881 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:04:28.492854 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545d8c89_dbd7_4cb3_b5dd_83b8089c7c1e.slice/crio-92f213feac6a0f1d4730e9ccdef442ba672a472345a1ae7256a171a69a87d3fc WatchSource:0}: Error finding container 92f213feac6a0f1d4730e9ccdef442ba672a472345a1ae7256a171a69a87d3fc: Status 404 returned error can't find the container with id 92f213feac6a0f1d4730e9ccdef442ba672a472345a1ae7256a171a69a87d3fc Jul 08 18:04:28.519173 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.519151 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:04:28.749351 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.749276 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs\") pod \"network-metrics-daemon-qd8c6\" (UID: \"f51e918c-72d1-41ce-bccb-04cf9571f9f8\") " pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:28.749351 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.749336 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret\") pod \"global-pull-secret-syncer-rj4rd\" (UID: \"d43bf8f7-16a4-4595-8185-6de3d1880faf\") " pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:28.749520 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:28.749436 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:04:28.749520 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:28.749447 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:04:28.749520 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:28.749492 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs podName:f51e918c-72d1-41ce-bccb-04cf9571f9f8 nodeName:}" failed. No retries permitted until 2026-07-08 18:04:29.749478065 +0000 UTC m=+3.993376207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs") pod "network-metrics-daemon-qd8c6" (UID: "f51e918c-72d1-41ce-bccb-04cf9571f9f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:04:28.749520 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:28.749506 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret podName:d43bf8f7-16a4-4595-8185-6de3d1880faf nodeName:}" failed. No retries permitted until 2026-07-08 18:04:29.749500209 +0000 UTC m=+3.993398352 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret") pod "global-pull-secret-syncer-rj4rd" (UID: "d43bf8f7-16a4-4595-8185-6de3d1880faf") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:04:28.850240 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:28.850200 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl58q\" (UniqueName: \"kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q\") pod \"network-check-target-nqpg2\" (UID: \"ab615a98-2754-4748-8f58-fbfecce973bd\") " pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:28.850741 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:28.850573 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:04:28.850741 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:28.850602 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:04:28.850741 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:28.850613 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rl58q for pod openshift-network-diagnostics/network-check-target-nqpg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:04:28.850741 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:28.850667 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q podName:ab615a98-2754-4748-8f58-fbfecce973bd nodeName:}" failed. No retries permitted until 2026-07-08 18:04:29.850651684 +0000 UTC m=+4.094549840 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rl58q" (UniqueName: "kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q") pod "network-check-target-nqpg2" (UID: "ab615a98-2754-4748-8f58-fbfecce973bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:04:29.173463 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:29.173360 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 17:59:27 +0000 UTC" deadline="2028-02-09 17:41:27.902988115 +0000 UTC" Jul 08 18:04:29.173463 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:29.173423 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13943h36m58.729570534s" Jul 08 18:04:29.265351 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:29.265322 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:29.265497 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:29.265364 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:29.265497 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:29.265439 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:04:29.265589 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:29.265548 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:04:29.272950 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:29.272915 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vvdbr" event={"ID":"545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e","Type":"ContainerStarted","Data":"92f213feac6a0f1d4730e9ccdef442ba672a472345a1ae7256a171a69a87d3fc"} Jul 08 18:04:29.274266 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:29.274222 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ntsb7" event={"ID":"3ac4ecbf-8862-4292-a3cf-40ac2f4c003c","Type":"ContainerStarted","Data":"5f37230e0cd770fd829da84fb827428174943b32344a8535e8df157568f1c7f6"} Jul 08 18:04:29.275443 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:29.275415 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xr57w" event={"ID":"5966f8d7-f706-4fba-a4d4-a6409cece4a6","Type":"ContainerStarted","Data":"2cec0a9d2a0a1c8d095ab7e0d1f6cf84ee46825957539ad1703117a88e41859d"} Jul 08 18:04:29.276785 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:29.276763 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" event={"ID":"83a9282f-204d-4877-b9b2-d5eb9caa7d5e","Type":"ContainerStarted","Data":"09699f48ee6c82de40ffc6b8b63acd0d06a9addf1c1225abb2c589dae5507908"} Jul 08 18:04:29.278048 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:29.278012 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7mggs" event={"ID":"7f3b0d99-28f8-4f35-a092-5be6eec3c766","Type":"ContainerStarted","Data":"5c624d38d7d07ba202fb00deb929386297895e3760a117871e291fbea5f33257"} Jul 08 18:04:29.279287 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:29.279267 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jwz48" event={"ID":"176823c4-1003-4325-a3fd-801fedcd0b43","Type":"ContainerStarted","Data":"1a3ecb48f4285439291e1655815484d7c6d1389780bfd4fcd46522fa15217e91"} Jul 08 18:04:29.280502 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:29.280481 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" event={"ID":"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe","Type":"ContainerStarted","Data":"3a98653d10cee70c6dd86069ef9914a91f861cd4b4a36d3bcdab0404f25dd594"} Jul 08 18:04:29.281661 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:29.281642 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qlclh" event={"ID":"83c8d1e2-db26-42ef-b62b-2b0fc021020a","Type":"ContainerStarted","Data":"3c01c1f87f13b5b5c3214fc0fabbcd22f95b50fd96809bf98970091b71f295e0"} Jul 08 18:04:29.283290 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:29.283267 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbs6w" event={"ID":"8e33d81c-69f4-41eb-8cfc-ca1563123bbb","Type":"ContainerStarted","Data":"c05257fda55409f5a71cb0e8c9303c866cc933e71eca155993f9ceafba329a2d"} Jul 08 18:04:29.756864 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:29.756812 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret\") pod \"global-pull-secret-syncer-rj4rd\" (UID: \"d43bf8f7-16a4-4595-8185-6de3d1880faf\") " pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:29.757035 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:29.756895 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs\") pod \"network-metrics-daemon-qd8c6\" (UID: \"f51e918c-72d1-41ce-bccb-04cf9571f9f8\") " pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:29.757115 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:29.757047 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:04:29.757115 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:29.757110 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs podName:f51e918c-72d1-41ce-bccb-04cf9571f9f8 nodeName:}" failed. No retries permitted until 2026-07-08 18:04:31.757091193 +0000 UTC m=+6.000989363 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs") pod "network-metrics-daemon-qd8c6" (UID: "f51e918c-72d1-41ce-bccb-04cf9571f9f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:04:29.757770 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:29.757477 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:04:29.757770 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:29.757524 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret podName:d43bf8f7-16a4-4595-8185-6de3d1880faf nodeName:}" failed. No retries permitted until 2026-07-08 18:04:31.757510533 +0000 UTC m=+6.001408678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret") pod "global-pull-secret-syncer-rj4rd" (UID: "d43bf8f7-16a4-4595-8185-6de3d1880faf") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:04:29.857930 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:29.857844 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl58q\" (UniqueName: \"kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q\") pod \"network-check-target-nqpg2\" (UID: \"ab615a98-2754-4748-8f58-fbfecce973bd\") " pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:29.858117 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:29.858017 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:04:29.858117 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:29.858055 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:04:29.858117 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:29.858068 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rl58q for pod openshift-network-diagnostics/network-check-target-nqpg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:04:29.858288 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:29.858127 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q podName:ab615a98-2754-4748-8f58-fbfecce973bd nodeName:}" failed. No retries permitted until 2026-07-08 18:04:31.858107167 +0000 UTC m=+6.102005313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rl58q" (UniqueName: "kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q") pod "network-check-target-nqpg2" (UID: "ab615a98-2754-4748-8f58-fbfecce973bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:04:30.267017 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:30.266991 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:30.267410 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:30.267146 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:04:30.302049 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:30.298601 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-15.ec2.internal" event={"ID":"fc962ef72161a4d249d8dfa152df87aa","Type":"ContainerStarted","Data":"17464fb2a2b9196a1be0475373467ae3fb351a94125d931dc0033095e8924d6f"} Jul 08 18:04:31.265417 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:31.265288 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:31.265601 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:31.265423 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:04:31.265601 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:31.265474 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:31.265601 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:31.265588 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:04:31.772290 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:31.771543 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret\") pod \"global-pull-secret-syncer-rj4rd\" (UID: \"d43bf8f7-16a4-4595-8185-6de3d1880faf\") " pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:31.772290 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:31.771629 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs\") pod \"network-metrics-daemon-qd8c6\" (UID: \"f51e918c-72d1-41ce-bccb-04cf9571f9f8\") " pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:31.772290 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:31.771751 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:04:31.772290 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:31.771809 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs podName:f51e918c-72d1-41ce-bccb-04cf9571f9f8 nodeName:}" failed. No retries permitted until 2026-07-08 18:04:35.77179014 +0000 UTC m=+10.015688300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs") pod "network-metrics-daemon-qd8c6" (UID: "f51e918c-72d1-41ce-bccb-04cf9571f9f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:04:31.772290 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:31.772208 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:04:31.772290 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:31.772258 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret podName:d43bf8f7-16a4-4595-8185-6de3d1880faf nodeName:}" failed. No retries permitted until 2026-07-08 18:04:35.772243191 +0000 UTC m=+10.016141340 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret") pod "global-pull-secret-syncer-rj4rd" (UID: "d43bf8f7-16a4-4595-8185-6de3d1880faf") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:04:31.872568 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:31.872518 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl58q\" (UniqueName: \"kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q\") pod \"network-check-target-nqpg2\" (UID: \"ab615a98-2754-4748-8f58-fbfecce973bd\") " pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:31.872734 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:31.872671 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:04:31.872734 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:31.872696 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:04:31.872734 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:31.872710 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rl58q for pod openshift-network-diagnostics/network-check-target-nqpg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:04:31.872896 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:31.872769 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q podName:ab615a98-2754-4748-8f58-fbfecce973bd nodeName:}" failed. No retries permitted until 2026-07-08 18:04:35.872748602 +0000 UTC m=+10.116646748 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rl58q" (UniqueName: "kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q") pod "network-check-target-nqpg2" (UID: "ab615a98-2754-4748-8f58-fbfecce973bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:04:32.266081 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:32.265972 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:32.266225 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:32.266140 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:04:33.265165 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:33.265132 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:33.265630 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:33.265134 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:33.265630 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:33.265253 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:04:33.265630 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:33.265345 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:04:34.267043 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:34.267006 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:34.267495 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:34.267161 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:04:35.265750 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:35.265670 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:35.265750 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:35.265682 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:35.265959 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:35.265790 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:04:35.265959 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:35.265907 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:04:35.801447 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:35.800769 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret\") pod \"global-pull-secret-syncer-rj4rd\" (UID: \"d43bf8f7-16a4-4595-8185-6de3d1880faf\") " pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:35.801447 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:35.800844 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs\") pod \"network-metrics-daemon-qd8c6\" (UID: \"f51e918c-72d1-41ce-bccb-04cf9571f9f8\") " pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:35.801447 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:35.800949 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:04:35.801447 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:35.800993 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs podName:f51e918c-72d1-41ce-bccb-04cf9571f9f8 nodeName:}" failed. No retries permitted until 2026-07-08 18:04:43.800978241 +0000 UTC m=+18.044876383 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs") pod "network-metrics-daemon-qd8c6" (UID: "f51e918c-72d1-41ce-bccb-04cf9571f9f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:04:35.801447 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:35.801369 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:04:35.801447 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:35.801417 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret podName:d43bf8f7-16a4-4595-8185-6de3d1880faf nodeName:}" failed. No retries permitted until 2026-07-08 18:04:43.80140289 +0000 UTC m=+18.045301038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret") pod "global-pull-secret-syncer-rj4rd" (UID: "d43bf8f7-16a4-4595-8185-6de3d1880faf") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:04:35.901785 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:35.901751 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl58q\" (UniqueName: \"kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q\") pod \"network-check-target-nqpg2\" (UID: \"ab615a98-2754-4748-8f58-fbfecce973bd\") " pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:35.901941 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:35.901912 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:04:35.901941 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:35.901934 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:04:35.902049 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:35.901949 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rl58q for pod openshift-network-diagnostics/network-check-target-nqpg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:04:35.902049 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:35.902015 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q podName:ab615a98-2754-4748-8f58-fbfecce973bd nodeName:}" failed. No retries permitted until 2026-07-08 18:04:43.901997266 +0000 UTC m=+18.145895418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rl58q" (UniqueName: "kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q") pod "network-check-target-nqpg2" (UID: "ab615a98-2754-4748-8f58-fbfecce973bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:04:36.265953 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:36.265864 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:36.266107 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:36.265991 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:04:37.265789 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:37.265756 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:37.266252 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:37.265880 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:04:37.266325 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:37.266307 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:37.266417 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:37.266396 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:04:38.265403 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:38.265373 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:38.265592 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:38.265514 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:04:39.264917 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:39.264888 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:39.265376 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:39.265012 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:04:39.265376 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:39.265118 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:39.265376 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:39.265290 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:04:40.268497 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:40.268468 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:40.268969 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:40.268597 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:04:40.268969 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:40.268658 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:40.268969 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:40.268748 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:04:41.265751 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:41.265723 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:41.265927 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:41.265837 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:04:42.268015 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:42.267982 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:42.268468 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:42.268139 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:04:42.268468 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:42.268203 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:42.268468 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:42.268290 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:04:43.265179 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:43.265147 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:43.265366 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:43.265266 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:04:43.866338 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:43.866301 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs\") pod \"network-metrics-daemon-qd8c6\" (UID: \"f51e918c-72d1-41ce-bccb-04cf9571f9f8\") " pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:43.866766 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:43.866369 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret\") pod \"global-pull-secret-syncer-rj4rd\" (UID: \"d43bf8f7-16a4-4595-8185-6de3d1880faf\") " pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:43.866766 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:43.866467 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:04:43.866766 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:43.866469 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:04:43.866766 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:43.866523 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret podName:d43bf8f7-16a4-4595-8185-6de3d1880faf nodeName:}" failed. No retries permitted until 2026-07-08 18:04:59.866506662 +0000 UTC m=+34.110404808 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret") pod "global-pull-secret-syncer-rj4rd" (UID: "d43bf8f7-16a4-4595-8185-6de3d1880faf") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:04:43.866766 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:43.866544 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs podName:f51e918c-72d1-41ce-bccb-04cf9571f9f8 nodeName:}" failed. No retries permitted until 2026-07-08 18:04:59.866533999 +0000 UTC m=+34.110432143 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs") pod "network-metrics-daemon-qd8c6" (UID: "f51e918c-72d1-41ce-bccb-04cf9571f9f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:04:43.967597 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:43.967569 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl58q\" (UniqueName: \"kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q\") pod \"network-check-target-nqpg2\" (UID: \"ab615a98-2754-4748-8f58-fbfecce973bd\") " pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:43.967742 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:43.967722 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:04:43.967798 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:43.967751 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:04:43.967798 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:43.967764 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rl58q for pod openshift-network-diagnostics/network-check-target-nqpg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:04:43.967894 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:43.967823 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q podName:ab615a98-2754-4748-8f58-fbfecce973bd nodeName:}" failed. No retries permitted until 2026-07-08 18:04:59.967805442 +0000 UTC m=+34.211703586 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rl58q" (UniqueName: "kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q") pod "network-check-target-nqpg2" (UID: "ab615a98-2754-4748-8f58-fbfecce973bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:04:44.265226 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:44.265192 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:44.265416 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:44.265311 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:04:44.265663 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:44.265191 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:44.265663 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:44.265616 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:04:45.265475 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:45.265440 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:45.265911 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:45.265569 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:04:46.266863 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:46.266832 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:46.267318 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:46.266949 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:04:46.267951 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:46.267927 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:46.268111 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:46.268043 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:04:47.264843 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:47.264810 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:47.265036 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:47.264940 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:04:48.265324 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:48.265132 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:48.265657 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:48.265407 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:04:48.265741 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:48.265717 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:48.265902 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:48.265828 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:04:48.363648 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:48.363595 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xr57w" event={"ID":"5966f8d7-f706-4fba-a4d4-a6409cece4a6","Type":"ContainerStarted","Data":"4c3852f835e627063b38bf6ce2b64274e5b9401b7ffee096c377dc933aaccbc0"} Jul 08 18:04:48.370206 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:48.370178 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7mggs" event={"ID":"7f3b0d99-28f8-4f35-a092-5be6eec3c766","Type":"ContainerStarted","Data":"e103fedb83debccdf96559e25c2bf81c5380ad43e5cdc7f362e4c548b05cf324"} Jul 08 18:04:48.391399 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:48.391340 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-15.ec2.internal" podStartSLOduration=21.391320922 podStartE2EDuration="21.391320922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:04:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:04:30.321616766 +0000 UTC m=+4.565514932" watchObservedRunningTime="2026-07-08 18:04:48.391320922 +0000 UTC m=+22.635219127" Jul 08 18:04:48.391567 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:48.391532 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xr57w" podStartSLOduration=2.761807181 podStartE2EDuration="22.391521519s" totalImagesPullingTime="19.629714338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:04:48.389922268 +0000 UTC m=+22.633820432" watchObservedRunningTime="2026-07-08 18:04:48.391521519 +0000 UTC m=+22.635419686" Jul 08 18:04:49.265463 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.265303 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:49.266107 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:49.265533 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:04:49.373367 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.373333 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ntsb7" event={"ID":"3ac4ecbf-8862-4292-a3cf-40ac2f4c003c","Type":"ContainerStarted","Data":"da4634cda48156add43fa205a83ba97e5de58ed64304e3d7c90836ee1bff0a1a"} Jul 08 18:04:49.374840 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.374817 2574 generic.go:356] "Generic (PLEG): container finished" podID="b901dfb04e817a9c04cdd81f64423379" containerID="bccec1d202723ab0a2368679994d5a37be360adf21c9479bab981c85335adb89" exitCode=0 Jul 08 18:04:49.374942 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.374889 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal" event={"ID":"b901dfb04e817a9c04cdd81f64423379","Type":"ContainerDied","Data":"bccec1d202723ab0a2368679994d5a37be360adf21c9479bab981c85335adb89"} Jul 08 18:04:49.376224 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.376199 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" event={"ID":"83a9282f-204d-4877-b9b2-d5eb9caa7d5e","Type":"ContainerStarted","Data":"50e964330a44ae25e2664f03cf70c806f31d167cb98a534a62181baa88640e80"} Jul 08 18:04:49.377648 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.377623 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jwz48" event={"ID":"176823c4-1003-4325-a3fd-801fedcd0b43","Type":"ContainerStarted","Data":"a19f3d9b196805b27bc4a86d6f2f1f55d15f5773072203998e548bc8c06a0809"} Jul 08 18:04:49.380250 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.380235 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9ftw_6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe/ovn-acl-logging/0.log" Jul 08 18:04:49.380528 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.380509 2574 generic.go:356] "Generic (PLEG): container finished" podID="6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe" containerID="bbfe2f36af9aeb1578520cc90ca922d95d7d77b1234094e6a0aafc9962887ee9" exitCode=1 Jul 08 18:04:49.380611 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.380532 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" event={"ID":"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe","Type":"ContainerStarted","Data":"1f5fb985c1af560053369fef6bcabd2ec72957a222a4e70d8af04887ef98c3b3"} Jul 08 18:04:49.380674 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.380616 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" event={"ID":"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe","Type":"ContainerStarted","Data":"2140f4331116a910656649e80161e884106216619ffad2941f9879200beb53e8"} Jul 08 18:04:49.380674 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.380667 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" event={"ID":"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe","Type":"ContainerStarted","Data":"bff1b210780c25743dfed5ed24b825ab294f17739db68f0989f9fc1e7d96cc00"} Jul 08 18:04:49.380777 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.380716 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" event={"ID":"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe","Type":"ContainerStarted","Data":"44e88f519cd77b715bf647df6bfed1e2f097996b5f4b9cd475dacd545281be82"} Jul 08 18:04:49.380777 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.380765 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" event={"ID":"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe","Type":"ContainerDied","Data":"bbfe2f36af9aeb1578520cc90ca922d95d7d77b1234094e6a0aafc9962887ee9"} Jul 08 18:04:49.380870 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.380815 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" event={"ID":"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe","Type":"ContainerStarted","Data":"8f4f46ee1a7223ac8fb3f6eab6f1e8ca572eb3c93b70ad8c7890ec6f8b6dc3b9"} Jul 08 18:04:49.381867 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.381849 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qlclh" event={"ID":"83c8d1e2-db26-42ef-b62b-2b0fc021020a","Type":"ContainerStarted","Data":"882195afd819615cd97f4051c99662e28c52cff19b13b03fc496beafbd20792c"} Jul 08 18:04:49.383265 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.383221 2574 generic.go:356] "Generic (PLEG): container finished" podID="8e33d81c-69f4-41eb-8cfc-ca1563123bbb" containerID="fc6a040c928934ea40b8087c67348b89bad924192849aee3c6c2503813b0d498" exitCode=0 Jul 08 18:04:49.383338 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.383293 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbs6w" event={"ID":"8e33d81c-69f4-41eb-8cfc-ca1563123bbb","Type":"ContainerDied","Data":"fc6a040c928934ea40b8087c67348b89bad924192849aee3c6c2503813b0d498"} Jul 08 18:04:49.384654 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.384576 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vvdbr" event={"ID":"545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e","Type":"ContainerStarted","Data":"28403e9e7766e5fd4107739eab9048196066084bd972e2edf904a36d09cb83ff"} Jul 08 18:04:49.391217 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.391182 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7mggs" podStartSLOduration=3.7173761069999998 podStartE2EDuration="23.391169781s" totalImagesPullingTime="19.673793674s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:04:48.408201308 +0000 UTC m=+22.652099474" watchObservedRunningTime="2026-07-08 18:04:49.391169781 +0000 UTC m=+23.635067945" Jul 08 18:04:49.406833 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.406795 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qlclh" podStartSLOduration=12.35174461 podStartE2EDuration="23.406787093s" totalImagesPullingTime="11.055042483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:04:49.40672637 +0000 UTC m=+23.650624534" watchObservedRunningTime="2026-07-08 18:04:49.406787093 +0000 UTC m=+23.650685257" Jul 08 18:04:49.406997 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.406977 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ntsb7" podStartSLOduration=12.370841973 podStartE2EDuration="23.406973818s" totalImagesPullingTime="11.036131845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:04:49.391218183 +0000 UTC m=+23.635116348" watchObservedRunningTime="2026-07-08 18:04:49.406973818 +0000 UTC m=+23.650871983" Jul 08 18:04:49.423950 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.423920 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jwz48" podStartSLOduration=12.401226295 podStartE2EDuration="23.423909209s" totalImagesPullingTime="11.022682914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:04:49.423826935 +0000 UTC m=+23.667725096" watchObservedRunningTime="2026-07-08 18:04:49.423909209 +0000 UTC m=+23.667807374" Jul 08 18:04:49.463175 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:49.463145 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vvdbr" podStartSLOduration=12.446352222 podStartE2EDuration="23.46313469s" totalImagesPullingTime="11.016782468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:04:49.462873754 +0000 UTC m=+23.706771918" watchObservedRunningTime="2026-07-08 18:04:49.46313469 +0000 UTC m=+23.707032855" Jul 08 18:04:50.265671 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:50.265640 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:50.266190 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:50.265745 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:04:50.266190 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:50.265799 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:50.266190 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:50.265885 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:04:51.267687 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:51.267241 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:51.267687 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:51.267524 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:04:51.349788 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:51.349764 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 18:04:51.390863 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:51.390844 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9ftw_6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe/ovn-acl-logging/0.log" Jul 08 18:04:51.391253 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:51.391231 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" event={"ID":"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe","Type":"ContainerStarted","Data":"aae891d0515df9ead3b352a1963d04638d959388b1a17e236ea38c4e3d303886"} Jul 08 18:04:51.392859 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:51.392840 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal" event={"ID":"b901dfb04e817a9c04cdd81f64423379","Type":"ContainerStarted","Data":"0675a040ec6ec3966c5761774926df1a99d6d6a5a1487f18cf758600fe1dfcee"} Jul 08 18:04:51.394490 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:51.394469 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" event={"ID":"83a9282f-204d-4877-b9b2-d5eb9caa7d5e","Type":"ContainerStarted","Data":"433ad601bfe491043d9025e627a0fd310d8afaea10906d28713901de511b8bc7"} Jul 08 18:04:51.411786 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:51.411747 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-15.ec2.internal" podStartSLOduration=24.411735097 podStartE2EDuration="24.411735097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:04:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:04:51.411320923 +0000 UTC m=+25.655219088" watchObservedRunningTime="2026-07-08 18:04:51.411735097 +0000 UTC m=+25.655633261" Jul 08 18:04:52.209960 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:52.209861 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T18:04:51.349784531Z","UUID":"7df6ac56-4ec9-4803-936a-270f17e89f2b","Handler":null,"Name":"","Endpoint":""} Jul 08 18:04:52.211466 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:52.211444 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 18:04:52.211603 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:52.211485 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 18:04:52.265545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:52.265519 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:52.265681 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:52.265634 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:04:52.265741 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:52.265727 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:52.265842 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:52.265823 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:04:53.264884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:53.264856 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:53.265545 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:53.264991 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:04:53.293015 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:53.292888 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ntsb7" Jul 08 18:04:53.293576 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:53.293559 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ntsb7" Jul 08 18:04:53.400603 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:53.400569 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" event={"ID":"83a9282f-204d-4877-b9b2-d5eb9caa7d5e","Type":"ContainerStarted","Data":"fcd15748b6941d6415bb94028761b3033dbeebaa299467f8c2e08267297ced93"} Jul 08 18:04:53.406154 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:53.404518 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9ftw_6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe/ovn-acl-logging/0.log" Jul 08 18:04:53.406154 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:53.405505 2574 scope.go:117] "RemoveContainer" containerID="bbfe2f36af9aeb1578520cc90ca922d95d7d77b1234094e6a0aafc9962887ee9" Jul 08 18:04:53.406154 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:53.405542 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" event={"ID":"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe","Type":"ContainerStarted","Data":"0652960d9b889fe0b2eeed7588d1d696b92ee009ce32e4bad18761f095f4fc49"} Jul 08 18:04:53.406154 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:53.405619 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ntsb7" Jul 08 18:04:53.406154 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:53.405879 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:53.406154 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:53.405936 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:53.406154 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:53.405978 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:53.406154 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:53.406121 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ntsb7" Jul 08 18:04:53.425515 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:53.425435 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:53.426578 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:53.426523 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95brd" podStartSLOduration=4.63653132 podStartE2EDuration="27.426505653s" totalImagesPullingTime="22.789974333s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:04:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:04:53.425997103 +0000 UTC m=+27.669895291" watchObservedRunningTime="2026-07-08 18:04:53.426505653 +0000 UTC m=+27.670403815" Jul 08 18:04:53.428010 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:53.427991 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:04:54.265155 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:54.265122 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:54.265155 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:54.265144 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:54.265639 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:54.265236 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:04:54.265639 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:54.265371 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:04:54.411666 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:54.411640 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9ftw_6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe/ovn-acl-logging/0.log" Jul 08 18:04:54.412091 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:54.412064 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" event={"ID":"6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe","Type":"ContainerStarted","Data":"1e99d85b9ee8c1bb729de3ea6ef32a1261e6666c124f55767f58ef58f646f695"} Jul 08 18:04:54.446831 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:54.444775 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" podStartSLOduration=8.58572907 podStartE2EDuration="28.444756385s" totalImagesPullingTime="19.859027315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:04:54.444047175 +0000 UTC m=+28.687945365" watchObservedRunningTime="2026-07-08 18:04:54.444756385 +0000 UTC m=+28.688654551" Jul 08 18:04:55.265116 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:55.265084 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:55.265280 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:55.265201 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:04:55.549093 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:55.549006 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rj4rd"] Jul 08 18:04:55.549093 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:55.549083 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nqpg2"] Jul 08 18:04:55.549292 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:55.549105 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qd8c6"] Jul 08 18:04:55.549292 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:55.549197 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:55.549372 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:55.549306 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:04:55.549372 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:55.549366 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:55.549450 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:55.549428 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:04:55.549508 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:55.549470 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:55.549552 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:55.549518 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:04:56.371078 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:56.371051 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vvdbr_545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e/dns-node-resolver/0.log" Jul 08 18:04:57.265170 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:57.265138 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:57.265356 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:57.265209 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:57.265356 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:57.265206 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:57.265356 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:57.265305 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:04:57.265519 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:57.265380 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:04:57.265519 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:57.265488 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:04:57.420160 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:57.420125 2574 generic.go:356] "Generic (PLEG): container finished" podID="8e33d81c-69f4-41eb-8cfc-ca1563123bbb" containerID="e02f8601cee47d9e621797dda97a7700cdca02433744a64ab8afb89892e51998" exitCode=0 Jul 08 18:04:57.420541 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:57.420174 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbs6w" event={"ID":"8e33d81c-69f4-41eb-8cfc-ca1563123bbb","Type":"ContainerDied","Data":"e02f8601cee47d9e621797dda97a7700cdca02433744a64ab8afb89892e51998"} Jul 08 18:04:57.548611 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:57.548558 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jwz48_176823c4-1003-4325-a3fd-801fedcd0b43/node-ca/0.log" Jul 08 18:04:59.264943 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:59.264903 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:59.264943 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:59.264938 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:59.265520 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:59.265044 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:59.265520 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:59.265047 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:04:59.265520 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:59.265124 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:04:59.265520 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:59.265209 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:04:59.425894 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:59.425861 2574 generic.go:356] "Generic (PLEG): container finished" podID="8e33d81c-69f4-41eb-8cfc-ca1563123bbb" containerID="ba201cc67abe905123426663e77863ee18ae97e25e50cb8d7c5e28c87a2b9e9d" exitCode=0 Jul 08 18:04:59.426038 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:59.425909 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbs6w" event={"ID":"8e33d81c-69f4-41eb-8cfc-ca1563123bbb","Type":"ContainerDied","Data":"ba201cc67abe905123426663e77863ee18ae97e25e50cb8d7c5e28c87a2b9e9d"} Jul 08 18:04:59.891677 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:59.891637 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret\") pod \"global-pull-secret-syncer-rj4rd\" (UID: \"d43bf8f7-16a4-4595-8185-6de3d1880faf\") " pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:04:59.891850 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:59.891714 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs\") pod \"network-metrics-daemon-qd8c6\" (UID: \"f51e918c-72d1-41ce-bccb-04cf9571f9f8\") " pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:04:59.891850 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:59.891764 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:04:59.891850 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:59.891802 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:04:59.891850 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:59.891820 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret podName:d43bf8f7-16a4-4595-8185-6de3d1880faf nodeName:}" failed. No retries permitted until 2026-07-08 18:05:31.891806266 +0000 UTC m=+66.135704409 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret") pod "global-pull-secret-syncer-rj4rd" (UID: "d43bf8f7-16a4-4595-8185-6de3d1880faf") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:04:59.891850 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:59.891841 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs podName:f51e918c-72d1-41ce-bccb-04cf9571f9f8 nodeName:}" failed. No retries permitted until 2026-07-08 18:05:31.891828341 +0000 UTC m=+66.135726483 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs") pod "network-metrics-daemon-qd8c6" (UID: "f51e918c-72d1-41ce-bccb-04cf9571f9f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:04:59.992600 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:04:59.992567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl58q\" (UniqueName: \"kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q\") pod \"network-check-target-nqpg2\" (UID: \"ab615a98-2754-4748-8f58-fbfecce973bd\") " pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:04:59.992774 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:59.992755 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:04:59.992830 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:59.992777 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:04:59.992830 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:59.992788 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rl58q for pod openshift-network-diagnostics/network-check-target-nqpg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:04:59.992907 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:04:59.992841 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q podName:ab615a98-2754-4748-8f58-fbfecce973bd nodeName:}" failed. No retries permitted until 2026-07-08 18:05:31.992823441 +0000 UTC m=+66.236721605 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rl58q" (UniqueName: "kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q") pod "network-check-target-nqpg2" (UID: "ab615a98-2754-4748-8f58-fbfecce973bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:05:00.430671 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:00.430639 2574 generic.go:356] "Generic (PLEG): container finished" podID="8e33d81c-69f4-41eb-8cfc-ca1563123bbb" containerID="0483817d68d42c51a5731e693a110a59359bf537bb7902a3bdce488e0508887f" exitCode=0 Jul 08 18:05:00.430998 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:00.430711 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbs6w" event={"ID":"8e33d81c-69f4-41eb-8cfc-ca1563123bbb","Type":"ContainerDied","Data":"0483817d68d42c51a5731e693a110a59359bf537bb7902a3bdce488e0508887f"} Jul 08 18:05:01.265829 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:01.265796 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:05:01.265983 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:01.265871 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:05:01.265983 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:01.265866 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:05:01.265983 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:01.265966 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:05:01.266180 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:01.266092 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:05:01.266180 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:01.266169 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:05:03.265397 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:03.265369 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:05:03.265397 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:03.265392 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:05:03.265785 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:03.265369 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:05:03.265785 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:03.265467 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:05:03.265785 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:03.265537 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:05:03.265785 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:03.265601 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:05:05.265894 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:05.265687 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:05:05.266403 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:05.265687 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:05:05.266403 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:05.266000 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:05:05.266403 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:05.265736 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:05:05.266403 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:05.266114 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:05:05.266403 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:05.266175 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:05:07.265650 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:07.265627 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:05:07.265650 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:07.265642 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:05:07.265966 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:07.265728 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:05:07.265966 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:07.265744 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:05:07.265966 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:07.265792 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:05:07.265966 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:07.265872 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:05:07.448820 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:07.448791 2574 generic.go:356] "Generic (PLEG): container finished" podID="8e33d81c-69f4-41eb-8cfc-ca1563123bbb" containerID="2635b7b3dc2b1d11e873452de06bcc2a60796b7f9dc36b72ba6ba6512108a101" exitCode=0 Jul 08 18:05:07.448986 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:07.448834 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbs6w" event={"ID":"8e33d81c-69f4-41eb-8cfc-ca1563123bbb","Type":"ContainerDied","Data":"2635b7b3dc2b1d11e873452de06bcc2a60796b7f9dc36b72ba6ba6512108a101"} Jul 08 18:05:08.454395 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:08.454362 2574 generic.go:356] "Generic (PLEG): container finished" podID="8e33d81c-69f4-41eb-8cfc-ca1563123bbb" containerID="d8cea0c4e29704d497139b87875de42eea9abf21f71722a3663fd69fe563eab3" exitCode=0 Jul 08 18:05:08.454785 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:08.454418 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbs6w" event={"ID":"8e33d81c-69f4-41eb-8cfc-ca1563123bbb","Type":"ContainerDied","Data":"d8cea0c4e29704d497139b87875de42eea9abf21f71722a3663fd69fe563eab3"} Jul 08 18:05:09.265149 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:09.265104 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:05:09.265307 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:09.265104 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:05:09.265307 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:09.265226 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:05:09.265307 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:09.265126 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:05:09.265440 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:09.265293 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:05:09.265440 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:09.265396 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:05:09.459821 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:09.459788 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbs6w" event={"ID":"8e33d81c-69f4-41eb-8cfc-ca1563123bbb","Type":"ContainerStarted","Data":"09f034879c897daf67c16beb199c868abacc9e6de1ea32a0b8bf38460d93e31e"} Jul 08 18:05:09.491206 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:09.491159 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kbs6w" podStartSLOduration=17.046763815 podStartE2EDuration="43.491145846s" totalImagesPullingTime="26.444382031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:04:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:09.490746237 +0000 UTC m=+43.734644404" watchObservedRunningTime="2026-07-08 18:05:09.491145846 +0000 UTC m=+43.735044011" Jul 08 18:05:11.265798 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:11.265762 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:05:11.266278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:11.265762 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:05:11.266278 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:11.265889 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:05:11.266278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:11.265770 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:05:11.266278 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:11.265948 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:05:11.266278 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:11.266015 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:05:13.265431 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:13.265401 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:05:13.265966 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:13.265401 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:05:13.265966 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:13.265521 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:05:13.265966 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:13.265405 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:05:13.265966 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:13.265588 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:05:13.265966 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:13.265665 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:05:15.265545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:15.265518 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:05:15.265892 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:15.265518 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:05:15.265892 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:15.265613 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:05:15.265892 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:15.265683 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:05:15.265892 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:15.265518 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:05:15.265892 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:15.265758 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:05:17.265369 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:17.265337 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:05:17.265753 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:17.265433 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:05:17.265753 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:17.265348 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:05:17.265753 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:17.265474 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:05:17.265753 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:17.265550 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:05:17.265753 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:17.265612 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:05:19.265044 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:19.265006 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:05:19.265554 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:19.265059 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:05:19.265554 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:19.265139 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqpg2" podUID="ab615a98-2754-4748-8f58-fbfecce973bd" Jul 08 18:05:19.265554 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:19.265175 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj4rd" podUID="d43bf8f7-16a4-4595-8185-6de3d1880faf" Jul 08 18:05:19.265554 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:19.265233 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:05:19.265554 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:19.265355 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd8c6" podUID="f51e918c-72d1-41ce-bccb-04cf9571f9f8" Jul 08 18:05:20.016921 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.016894 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-15.ec2.internal" event="NodeReady" Jul 08 18:05:20.017092 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.017002 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 18:05:20.084733 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.084706 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58b7c645bc-fvjx2"] Jul 08 18:05:20.103787 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.103764 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.106442 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.106415 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 18:05:20.107569 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.107546 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9qxwl\"" Jul 08 18:05:20.107678 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.107659 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58b7c645bc-fvjx2"] Jul 08 18:05:20.107960 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.107945 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 18:05:20.111263 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.111139 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-66fq4"] Jul 08 18:05:20.113749 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.113732 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 18:05:20.124310 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.124291 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 18:05:20.131571 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.131555 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-l8ggh"] Jul 08 18:05:20.131679 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.131664 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-66fq4" Jul 08 18:05:20.137082 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.137064 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mmswz\"" Jul 08 18:05:20.137179 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.137105 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 18:05:20.138224 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.137552 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 18:05:20.143690 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.143669 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-66fq4"] Jul 08 18:05:20.143768 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.143705 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l8ggh"] Jul 08 18:05:20.143768 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.143761 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l8ggh" Jul 08 18:05:20.145108 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.145087 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10ed572b-9033-483f-ac88-a23fc874b33c-registry-certificates\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.145196 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.145133 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10ed572b-9033-483f-ac88-a23fc874b33c-bound-sa-token\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.145251 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.145234 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10ed572b-9033-483f-ac88-a23fc874b33c-installation-pull-secrets\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.145295 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.145259 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztzfc\" (UniqueName: \"kubernetes.io/projected/10ed572b-9033-483f-ac88-a23fc874b33c-kube-api-access-ztzfc\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.145295 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.145277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10ed572b-9033-483f-ac88-a23fc874b33c-image-registry-private-configuration\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.145375 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.145294 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10ed572b-9033-483f-ac88-a23fc874b33c-ca-trust-extracted\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.145375 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.145310 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10ed572b-9033-483f-ac88-a23fc874b33c-trusted-ca\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.145375 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.145330 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10ed572b-9033-483f-ac88-a23fc874b33c-registry-tls\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.152771 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.152752 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 18:05:20.152841 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.152752 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cd4hg\"" Jul 08 18:05:20.152841 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.152807 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 18:05:20.153084 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.153072 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 18:05:20.171143 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.171121 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m6jc4"] Jul 08 18:05:20.191615 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.191597 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m6jc4" Jul 08 18:05:20.196549 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.196527 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m6jc4"] Jul 08 18:05:20.200201 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.200183 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 18:05:20.200297 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.200185 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 18:05:20.200828 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.200810 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 18:05:20.200910 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.200843 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 18:05:20.209988 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.209973 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tfxt7\"" Jul 08 18:05:20.245737 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.245718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10ed572b-9033-483f-ac88-a23fc874b33c-installation-pull-secrets\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.245855 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.245743 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztzfc\" (UniqueName: \"kubernetes.io/projected/10ed572b-9033-483f-ac88-a23fc874b33c-kube-api-access-ztzfc\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.245855 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.245763 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10ed572b-9033-483f-ac88-a23fc874b33c-image-registry-private-configuration\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.245855 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.245779 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10ed572b-9033-483f-ac88-a23fc874b33c-ca-trust-extracted\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.245855 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.245794 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10ed572b-9033-483f-ac88-a23fc874b33c-trusted-ca\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.245855 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.245814 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e4feae0-24bb-400d-976c-3db46684588e-data-volume\") pod \"insights-runtime-extractor-m6jc4\" (UID: \"0e4feae0-24bb-400d-976c-3db46684588e\") " pod="openshift-insights/insights-runtime-extractor-m6jc4" Jul 08 18:05:20.245855 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.245836 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48kkq\" (UniqueName: \"kubernetes.io/projected/0e4feae0-24bb-400d-976c-3db46684588e-kube-api-access-48kkq\") pod \"insights-runtime-extractor-m6jc4\" (UID: \"0e4feae0-24bb-400d-976c-3db46684588e\") " pod="openshift-insights/insights-runtime-extractor-m6jc4" Jul 08 18:05:20.246192 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.245859 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e4feae0-24bb-400d-976c-3db46684588e-crio-socket\") pod \"insights-runtime-extractor-m6jc4\" (UID: \"0e4feae0-24bb-400d-976c-3db46684588e\") " pod="openshift-insights/insights-runtime-extractor-m6jc4" Jul 08 18:05:20.246192 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.245882 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e4feae0-24bb-400d-976c-3db46684588e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m6jc4\" (UID: \"0e4feae0-24bb-400d-976c-3db46684588e\") " pod="openshift-insights/insights-runtime-extractor-m6jc4" Jul 08 18:05:20.246192 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.245945 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10ed572b-9033-483f-ac88-a23fc874b33c-registry-tls\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.246192 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.245995 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad84f73e-6bc8-4508-97ec-ef3138d4685f-config-volume\") pod \"dns-default-66fq4\" (UID: \"ad84f73e-6bc8-4508-97ec-ef3138d4685f\") " pod="openshift-dns/dns-default-66fq4" Jul 08 18:05:20.246192 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.246087 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad84f73e-6bc8-4508-97ec-ef3138d4685f-tmp-dir\") pod \"dns-default-66fq4\" (UID: \"ad84f73e-6bc8-4508-97ec-ef3138d4685f\") " pod="openshift-dns/dns-default-66fq4" Jul 08 18:05:20.246192 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.246136 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f28z\" (UniqueName: \"kubernetes.io/projected/82f820f2-a049-41be-a661-f822def1a3ea-kube-api-access-9f28z\") pod \"ingress-canary-l8ggh\" (UID: \"82f820f2-a049-41be-a661-f822def1a3ea\") " pod="openshift-ingress-canary/ingress-canary-l8ggh" Jul 08 18:05:20.246192 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.246169 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad84f73e-6bc8-4508-97ec-ef3138d4685f-metrics-tls\") pod \"dns-default-66fq4\" (UID: \"ad84f73e-6bc8-4508-97ec-ef3138d4685f\") " pod="openshift-dns/dns-default-66fq4" Jul 08 18:05:20.246532 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.246247 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10ed572b-9033-483f-ac88-a23fc874b33c-ca-trust-extracted\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.246532 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.246250 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10ed572b-9033-483f-ac88-a23fc874b33c-registry-certificates\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.246532 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.246327 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e4feae0-24bb-400d-976c-3db46684588e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m6jc4\" (UID: \"0e4feae0-24bb-400d-976c-3db46684588e\") " pod="openshift-insights/insights-runtime-extractor-m6jc4" Jul 08 18:05:20.246532 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.246380 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10ed572b-9033-483f-ac88-a23fc874b33c-bound-sa-token\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.246532 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.246408 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9rsr\" (UniqueName: \"kubernetes.io/projected/ad84f73e-6bc8-4508-97ec-ef3138d4685f-kube-api-access-x9rsr\") pod \"dns-default-66fq4\" (UID: \"ad84f73e-6bc8-4508-97ec-ef3138d4685f\") " pod="openshift-dns/dns-default-66fq4" Jul 08 18:05:20.246532 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.246461 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82f820f2-a049-41be-a661-f822def1a3ea-cert\") pod \"ingress-canary-l8ggh\" (UID: \"82f820f2-a049-41be-a661-f822def1a3ea\") " pod="openshift-ingress-canary/ingress-canary-l8ggh" Jul 08 18:05:20.247098 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.247049 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10ed572b-9033-483f-ac88-a23fc874b33c-registry-certificates\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.247453 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.247433 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10ed572b-9033-483f-ac88-a23fc874b33c-trusted-ca\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.250112 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.250092 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10ed572b-9033-483f-ac88-a23fc874b33c-installation-pull-secrets\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.250208 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.250191 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10ed572b-9033-483f-ac88-a23fc874b33c-registry-tls\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.250530 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.250510 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10ed572b-9033-483f-ac88-a23fc874b33c-image-registry-private-configuration\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.256873 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.256854 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztzfc\" (UniqueName: \"kubernetes.io/projected/10ed572b-9033-483f-ac88-a23fc874b33c-kube-api-access-ztzfc\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.258902 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.258886 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10ed572b-9033-483f-ac88-a23fc874b33c-bound-sa-token\") pod \"image-registry-58b7c645bc-fvjx2\" (UID: \"10ed572b-9033-483f-ac88-a23fc874b33c\") " pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.347053 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.346966 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e4feae0-24bb-400d-976c-3db46684588e-data-volume\") pod \"insights-runtime-extractor-m6jc4\" (UID: \"0e4feae0-24bb-400d-976c-3db46684588e\") " pod="openshift-insights/insights-runtime-extractor-m6jc4" Jul 08 18:05:20.347053 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.347002 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48kkq\" (UniqueName: \"kubernetes.io/projected/0e4feae0-24bb-400d-976c-3db46684588e-kube-api-access-48kkq\") pod \"insights-runtime-extractor-m6jc4\" (UID: \"0e4feae0-24bb-400d-976c-3db46684588e\") " pod="openshift-insights/insights-runtime-extractor-m6jc4" Jul 08 18:05:20.347053 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.347038 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e4feae0-24bb-400d-976c-3db46684588e-crio-socket\") pod \"insights-runtime-extractor-m6jc4\" (UID: \"0e4feae0-24bb-400d-976c-3db46684588e\") " pod="openshift-insights/insights-runtime-extractor-m6jc4" Jul 08 18:05:20.347605 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.347061 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e4feae0-24bb-400d-976c-3db46684588e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m6jc4\" (UID: \"0e4feae0-24bb-400d-976c-3db46684588e\") " pod="openshift-insights/insights-runtime-extractor-m6jc4" Jul 08 18:05:20.347605 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.347081 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad84f73e-6bc8-4508-97ec-ef3138d4685f-config-volume\") pod \"dns-default-66fq4\" (UID: \"ad84f73e-6bc8-4508-97ec-ef3138d4685f\") " pod="openshift-dns/dns-default-66fq4" Jul 08 18:05:20.347605 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.347116 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad84f73e-6bc8-4508-97ec-ef3138d4685f-tmp-dir\") pod \"dns-default-66fq4\" (UID: \"ad84f73e-6bc8-4508-97ec-ef3138d4685f\") " pod="openshift-dns/dns-default-66fq4" Jul 08 18:05:20.347605 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.347145 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f28z\" (UniqueName: \"kubernetes.io/projected/82f820f2-a049-41be-a661-f822def1a3ea-kube-api-access-9f28z\") pod \"ingress-canary-l8ggh\" (UID: \"82f820f2-a049-41be-a661-f822def1a3ea\") " pod="openshift-ingress-canary/ingress-canary-l8ggh" Jul 08 18:05:20.347605 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.347170 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad84f73e-6bc8-4508-97ec-ef3138d4685f-metrics-tls\") pod \"dns-default-66fq4\" (UID: \"ad84f73e-6bc8-4508-97ec-ef3138d4685f\") " pod="openshift-dns/dns-default-66fq4" Jul 08 18:05:20.347605 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.347210 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e4feae0-24bb-400d-976c-3db46684588e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m6jc4\" (UID: \"0e4feae0-24bb-400d-976c-3db46684588e\") " pod="openshift-insights/insights-runtime-extractor-m6jc4" Jul 08 18:05:20.347605 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.347249 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9rsr\" (UniqueName: \"kubernetes.io/projected/ad84f73e-6bc8-4508-97ec-ef3138d4685f-kube-api-access-x9rsr\") pod \"dns-default-66fq4\" (UID: \"ad84f73e-6bc8-4508-97ec-ef3138d4685f\") " pod="openshift-dns/dns-default-66fq4" Jul 08 18:05:20.347605 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.347285 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82f820f2-a049-41be-a661-f822def1a3ea-cert\") pod \"ingress-canary-l8ggh\" (UID: \"82f820f2-a049-41be-a661-f822def1a3ea\") " pod="openshift-ingress-canary/ingress-canary-l8ggh" Jul 08 18:05:20.347605 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.347315 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e4feae0-24bb-400d-976c-3db46684588e-crio-socket\") pod \"insights-runtime-extractor-m6jc4\" (UID: \"0e4feae0-24bb-400d-976c-3db46684588e\") " pod="openshift-insights/insights-runtime-extractor-m6jc4" Jul 08 18:05:20.347605 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.347326 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e4feae0-24bb-400d-976c-3db46684588e-data-volume\") pod \"insights-runtime-extractor-m6jc4\" (UID: \"0e4feae0-24bb-400d-976c-3db46684588e\") " pod="openshift-insights/insights-runtime-extractor-m6jc4" Jul 08 18:05:20.347605 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.347476 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad84f73e-6bc8-4508-97ec-ef3138d4685f-tmp-dir\") pod \"dns-default-66fq4\" (UID: \"ad84f73e-6bc8-4508-97ec-ef3138d4685f\") " pod="openshift-dns/dns-default-66fq4" Jul 08 18:05:20.348087 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.347709 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e4feae0-24bb-400d-976c-3db46684588e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m6jc4\" (UID: \"0e4feae0-24bb-400d-976c-3db46684588e\") " pod="openshift-insights/insights-runtime-extractor-m6jc4" Jul 08 18:05:20.348087 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.347882 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad84f73e-6bc8-4508-97ec-ef3138d4685f-config-volume\") pod \"dns-default-66fq4\" (UID: \"ad84f73e-6bc8-4508-97ec-ef3138d4685f\") " pod="openshift-dns/dns-default-66fq4" Jul 08 18:05:20.349614 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.349585 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e4feae0-24bb-400d-976c-3db46684588e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m6jc4\" (UID: \"0e4feae0-24bb-400d-976c-3db46684588e\") " pod="openshift-insights/insights-runtime-extractor-m6jc4" Jul 08 18:05:20.349745 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.349723 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad84f73e-6bc8-4508-97ec-ef3138d4685f-metrics-tls\") pod \"dns-default-66fq4\" (UID: \"ad84f73e-6bc8-4508-97ec-ef3138d4685f\") " pod="openshift-dns/dns-default-66fq4" Jul 08 18:05:20.349861 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.349842 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82f820f2-a049-41be-a661-f822def1a3ea-cert\") pod \"ingress-canary-l8ggh\" (UID: \"82f820f2-a049-41be-a661-f822def1a3ea\") " pod="openshift-ingress-canary/ingress-canary-l8ggh" Jul 08 18:05:20.364094 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.364066 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f28z\" (UniqueName: \"kubernetes.io/projected/82f820f2-a049-41be-a661-f822def1a3ea-kube-api-access-9f28z\") pod \"ingress-canary-l8ggh\" (UID: \"82f820f2-a049-41be-a661-f822def1a3ea\") " pod="openshift-ingress-canary/ingress-canary-l8ggh" Jul 08 18:05:20.364212 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.364172 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48kkq\" (UniqueName: \"kubernetes.io/projected/0e4feae0-24bb-400d-976c-3db46684588e-kube-api-access-48kkq\") pod \"insights-runtime-extractor-m6jc4\" (UID: \"0e4feae0-24bb-400d-976c-3db46684588e\") " pod="openshift-insights/insights-runtime-extractor-m6jc4" Jul 08 18:05:20.364272 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.364233 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9rsr\" (UniqueName: \"kubernetes.io/projected/ad84f73e-6bc8-4508-97ec-ef3138d4685f-kube-api-access-x9rsr\") pod \"dns-default-66fq4\" (UID: \"ad84f73e-6bc8-4508-97ec-ef3138d4685f\") " pod="openshift-dns/dns-default-66fq4" Jul 08 18:05:20.414148 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.414128 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:20.440662 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.440638 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-66fq4" Jul 08 18:05:20.452677 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.452645 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l8ggh" Jul 08 18:05:20.500516 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.500267 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m6jc4" Jul 08 18:05:20.584179 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.579072 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58b7c645bc-fvjx2"] Jul 08 18:05:20.592958 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:05:20.592906 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10ed572b_9033_483f_ac88_a23fc874b33c.slice/crio-c37a909675cc997e88cf85ded6c24e6a5555b06784600b20c91877e6e9ab2129 WatchSource:0}: Error finding container c37a909675cc997e88cf85ded6c24e6a5555b06784600b20c91877e6e9ab2129: Status 404 returned error can't find the container with id c37a909675cc997e88cf85ded6c24e6a5555b06784600b20c91877e6e9ab2129 Jul 08 18:05:20.598852 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.598745 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-66fq4"] Jul 08 18:05:20.605677 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:05:20.605650 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad84f73e_6bc8_4508_97ec_ef3138d4685f.slice/crio-492f29c3eec763c7a43db7dc82ed8c10618f1744abe3ecde1de6bcd7d727c7bd WatchSource:0}: Error finding container 492f29c3eec763c7a43db7dc82ed8c10618f1744abe3ecde1de6bcd7d727c7bd: Status 404 returned error can't find the container with id 492f29c3eec763c7a43db7dc82ed8c10618f1744abe3ecde1de6bcd7d727c7bd Jul 08 18:05:20.649007 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.648984 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l8ggh"] Jul 08 18:05:20.652888 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:05:20.652863 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82f820f2_a049_41be_a661_f822def1a3ea.slice/crio-5a2100aa2d2d0e3a4732b805dd6de07002742741dbfa9ab91ac809598015a3a6 WatchSource:0}: Error finding container 5a2100aa2d2d0e3a4732b805dd6de07002742741dbfa9ab91ac809598015a3a6: Status 404 returned error can't find the container with id 5a2100aa2d2d0e3a4732b805dd6de07002742741dbfa9ab91ac809598015a3a6 Jul 08 18:05:20.667731 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:20.667699 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m6jc4"] Jul 08 18:05:20.669703 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:05:20.669681 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4feae0_24bb_400d_976c_3db46684588e.slice/crio-51b51a4e538693bbdf33ea3d8257600644ce71b6b36b5aacff17d98dd3a6d996 WatchSource:0}: Error finding container 51b51a4e538693bbdf33ea3d8257600644ce71b6b36b5aacff17d98dd3a6d996: Status 404 returned error can't find the container with id 51b51a4e538693bbdf33ea3d8257600644ce71b6b36b5aacff17d98dd3a6d996 Jul 08 18:05:21.265501 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:21.265470 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:05:21.265816 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:21.265803 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:05:21.266535 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:21.266090 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:05:21.272372 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:21.272325 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 18:05:21.274225 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:21.274202 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 18:05:21.274341 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:21.274209 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p8pfq\"" Jul 08 18:05:21.274341 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:21.274162 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 18:05:21.274341 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:21.274324 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 18:05:21.274615 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:21.274599 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d9s8r\"" Jul 08 18:05:21.491618 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:21.491582 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m6jc4" event={"ID":"0e4feae0-24bb-400d-976c-3db46684588e","Type":"ContainerStarted","Data":"51b51a4e538693bbdf33ea3d8257600644ce71b6b36b5aacff17d98dd3a6d996"} Jul 08 18:05:21.494195 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:21.494162 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" event={"ID":"10ed572b-9033-483f-ac88-a23fc874b33c","Type":"ContainerStarted","Data":"6f706eb476e1282d2146f0683daa4ff8d261631762e386431dc72c24b92d8099"} Jul 08 18:05:21.494318 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:21.494218 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" event={"ID":"10ed572b-9033-483f-ac88-a23fc874b33c","Type":"ContainerStarted","Data":"c37a909675cc997e88cf85ded6c24e6a5555b06784600b20c91877e6e9ab2129"} Jul 08 18:05:21.494898 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:21.494878 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:21.496569 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:21.496545 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l8ggh" event={"ID":"82f820f2-a049-41be-a661-f822def1a3ea","Type":"ContainerStarted","Data":"5a2100aa2d2d0e3a4732b805dd6de07002742741dbfa9ab91ac809598015a3a6"} Jul 08 18:05:21.498576 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:21.498527 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-66fq4" event={"ID":"ad84f73e-6bc8-4508-97ec-ef3138d4685f","Type":"ContainerStarted","Data":"492f29c3eec763c7a43db7dc82ed8c10618f1744abe3ecde1de6bcd7d727c7bd"} Jul 08 18:05:21.523400 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:21.523254 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" podStartSLOduration=2.523238042 podStartE2EDuration="2.523238042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:05:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:21.521981552 +0000 UTC m=+55.765879747" watchObservedRunningTime="2026-07-08 18:05:21.523238042 +0000 UTC m=+55.767136209" Jul 08 18:05:23.741808 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:23.741781 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qrhcw"] Jul 08 18:05:23.749052 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:23.749013 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qrhcw" Jul 08 18:05:23.752401 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:23.752378 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 08 18:05:23.752684 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:23.752667 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-p7tz6\"" Jul 08 18:05:23.761370 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:23.761347 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qrhcw"] Jul 08 18:05:23.777796 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:23.777774 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a927a850-002b-47d1-8666-c6f46d14791d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-qrhcw\" (UID: \"a927a850-002b-47d1-8666-c6f46d14791d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qrhcw" Jul 08 18:05:23.878904 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:23.878871 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a927a850-002b-47d1-8666-c6f46d14791d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-qrhcw\" (UID: \"a927a850-002b-47d1-8666-c6f46d14791d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qrhcw" Jul 08 18:05:23.879152 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:23.878986 2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 08 18:05:23.879152 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:05:23.879079 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a927a850-002b-47d1-8666-c6f46d14791d-tls-certificates podName:a927a850-002b-47d1-8666-c6f46d14791d nodeName:}" failed. No retries permitted until 2026-07-08 18:05:24.379059912 +0000 UTC m=+58.622958055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/a927a850-002b-47d1-8666-c6f46d14791d-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-qrhcw" (UID: "a927a850-002b-47d1-8666-c6f46d14791d") : secret "prometheus-operator-admission-webhook-tls" not found Jul 08 18:05:24.382980 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:24.382948 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a927a850-002b-47d1-8666-c6f46d14791d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-qrhcw\" (UID: \"a927a850-002b-47d1-8666-c6f46d14791d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qrhcw" Jul 08 18:05:24.385857 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:24.385832 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a927a850-002b-47d1-8666-c6f46d14791d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-qrhcw\" (UID: \"a927a850-002b-47d1-8666-c6f46d14791d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qrhcw" Jul 08 18:05:24.658809 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:24.658714 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qrhcw" Jul 08 18:05:25.424471 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:25.424441 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9ftw" Jul 08 18:05:25.886662 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:25.886636 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qrhcw"] Jul 08 18:05:26.512634 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:26.512591 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l8ggh" event={"ID":"82f820f2-a049-41be-a661-f822def1a3ea","Type":"ContainerStarted","Data":"206dca15e46a2f32d0ebeb48d749c601ceb8abf53c52df593cbb12ce67b52fae"} Jul 08 18:05:26.514271 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:26.514246 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-66fq4" event={"ID":"ad84f73e-6bc8-4508-97ec-ef3138d4685f","Type":"ContainerStarted","Data":"405a11f0ff48ac5203cc554b86d89e02c2208462e3829c63b1d3de0f86b8588e"} Jul 08 18:05:26.514426 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:26.514286 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-66fq4" event={"ID":"ad84f73e-6bc8-4508-97ec-ef3138d4685f","Type":"ContainerStarted","Data":"642ddba63235852ce5687cbda3c7640c247d522f656f14b1dc3c3e630406f624"} Jul 08 18:05:26.514426 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:26.514306 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-66fq4" Jul 08 18:05:26.515804 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:26.515782 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m6jc4" event={"ID":"0e4feae0-24bb-400d-976c-3db46684588e","Type":"ContainerStarted","Data":"7b5e1a0ee6d35f34b56119c91488eaaa290ea9532a54ba2e870ad72b8636e874"} Jul 08 18:05:26.516914 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:26.516896 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qrhcw" event={"ID":"a927a850-002b-47d1-8666-c6f46d14791d","Type":"ContainerStarted","Data":"929e131cf1daec8e59407ddb4828c45d7d1586e23a928cbce668b090df745dcf"} Jul 08 18:05:26.581792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:26.581756 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-66fq4" podStartSLOduration=1.449796625 podStartE2EDuration="6.58174233s" totalImagesPullingTime="5.131945705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:26.580820224 +0000 UTC m=+60.824718400" watchObservedRunningTime="2026-07-08 18:05:26.58174233 +0000 UTC m=+60.825640516" Jul 08 18:05:27.524101 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:27.524064 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m6jc4" event={"ID":"0e4feae0-24bb-400d-976c-3db46684588e","Type":"ContainerStarted","Data":"b31b614540ee791b6ef49beb40573b68cf0bc0c9bf88900350e8d4ab407acd2f"} Jul 08 18:05:28.530237 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:28.530200 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qrhcw" event={"ID":"a927a850-002b-47d1-8666-c6f46d14791d","Type":"ContainerStarted","Data":"224303fb7d17ecc47524675d8f5f40849a145856f40b897c6d99e670673ef576"} Jul 08 18:05:28.530671 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:28.530375 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qrhcw" Jul 08 18:05:28.535466 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:28.535445 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qrhcw" Jul 08 18:05:28.554848 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:28.554804 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qrhcw" podStartSLOduration=3.615672621 podStartE2EDuration="5.554789761s" totalImagesPullingTime="1.93911714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:28.554519387 +0000 UTC m=+62.798417553" watchObservedRunningTime="2026-07-08 18:05:28.554789761 +0000 UTC m=+62.798687904" Jul 08 18:05:28.555133 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:28.555102 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-l8ggh" podStartSLOduration=3.450268042 podStartE2EDuration="8.555091198s" totalImagesPullingTime="5.104823156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:26.601681203 +0000 UTC m=+60.845579369" watchObservedRunningTime="2026-07-08 18:05:28.555091198 +0000 UTC m=+62.798989364" Jul 08 18:05:29.534758 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:29.534729 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m6jc4" event={"ID":"0e4feae0-24bb-400d-976c-3db46684588e","Type":"ContainerStarted","Data":"4c2473c77234e1c55518ecc89c5bcdf427a72d0a0d076d31588640981d7bface"} Jul 08 18:05:29.564815 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:29.564742 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m6jc4" podStartSLOduration=1.120062931 podStartE2EDuration="9.56472571s" totalImagesPullingTime="8.444662779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:05:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:29.56231043 +0000 UTC m=+63.806208609" watchObservedRunningTime="2026-07-08 18:05:29.56472571 +0000 UTC m=+63.808623874" Jul 08 18:05:31.934223 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:31.934188 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret\") pod \"global-pull-secret-syncer-rj4rd\" (UID: \"d43bf8f7-16a4-4595-8185-6de3d1880faf\") " pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:05:31.934596 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:31.934246 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs\") pod \"network-metrics-daemon-qd8c6\" (UID: \"f51e918c-72d1-41ce-bccb-04cf9571f9f8\") " pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:05:31.938360 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:31.938342 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 18:05:31.939197 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:31.939181 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 18:05:31.946751 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:31.946720 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f51e918c-72d1-41ce-bccb-04cf9571f9f8-metrics-certs\") pod \"network-metrics-daemon-qd8c6\" (UID: \"f51e918c-72d1-41ce-bccb-04cf9571f9f8\") " pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:05:31.946862 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:31.946846 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d43bf8f7-16a4-4595-8185-6de3d1880faf-original-pull-secret\") pod \"global-pull-secret-syncer-rj4rd\" (UID: \"d43bf8f7-16a4-4595-8185-6de3d1880faf\") " pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:05:32.035020 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:32.034978 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl58q\" (UniqueName: \"kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q\") pod \"network-check-target-nqpg2\" (UID: \"ab615a98-2754-4748-8f58-fbfecce973bd\") " pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:05:32.038189 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:32.038172 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 18:05:32.048725 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:32.048705 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 18:05:32.058506 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:32.058482 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl58q\" (UniqueName: \"kubernetes.io/projected/ab615a98-2754-4748-8f58-fbfecce973bd-kube-api-access-rl58q\") pod \"network-check-target-nqpg2\" (UID: \"ab615a98-2754-4748-8f58-fbfecce973bd\") " pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:05:32.092784 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:32.092764 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p8pfq\"" Jul 08 18:05:32.098542 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:32.098524 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd8c6" Jul 08 18:05:32.099596 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:32.099582 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d9s8r\"" Jul 08 18:05:32.103486 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:32.103472 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj4rd" Jul 08 18:05:32.107200 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:32.107183 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:05:32.269482 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:32.269459 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qd8c6"] Jul 08 18:05:32.271923 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:05:32.271899 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf51e918c_72d1_41ce_bccb_04cf9571f9f8.slice/crio-6a4eb8449c8306aa16a699350e8a713464c3212fcf38f95ee454a5a754ea8998 WatchSource:0}: Error finding container 6a4eb8449c8306aa16a699350e8a713464c3212fcf38f95ee454a5a754ea8998: Status 404 returned error can't find the container with id 6a4eb8449c8306aa16a699350e8a713464c3212fcf38f95ee454a5a754ea8998 Jul 08 18:05:32.490512 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:32.490444 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rj4rd"] Jul 08 18:05:32.493742 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:05:32.493717 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd43bf8f7_16a4_4595_8185_6de3d1880faf.slice/crio-8620750b7649e44548adad0c9aee94783a705fec6489f008d60ad77cae169a53 WatchSource:0}: Error finding container 8620750b7649e44548adad0c9aee94783a705fec6489f008d60ad77cae169a53: Status 404 returned error can't find the container with id 8620750b7649e44548adad0c9aee94783a705fec6489f008d60ad77cae169a53 Jul 08 18:05:32.494321 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:05:32.494300 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab615a98_2754_4748_8f58_fbfecce973bd.slice/crio-f4506341cca329668325f3213e9d44c2fdc4e9c76e130eaac0b06cf780908714 WatchSource:0}: Error finding container f4506341cca329668325f3213e9d44c2fdc4e9c76e130eaac0b06cf780908714: Status 404 returned error can't find the container with id f4506341cca329668325f3213e9d44c2fdc4e9c76e130eaac0b06cf780908714 Jul 08 18:05:32.495500 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:32.495479 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nqpg2"] Jul 08 18:05:32.544803 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:32.544771 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rj4rd" event={"ID":"d43bf8f7-16a4-4595-8185-6de3d1880faf","Type":"ContainerStarted","Data":"8620750b7649e44548adad0c9aee94783a705fec6489f008d60ad77cae169a53"} Jul 08 18:05:32.545822 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:32.545789 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nqpg2" event={"ID":"ab615a98-2754-4748-8f58-fbfecce973bd","Type":"ContainerStarted","Data":"f4506341cca329668325f3213e9d44c2fdc4e9c76e130eaac0b06cf780908714"} Jul 08 18:05:32.546836 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:32.546818 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qd8c6" event={"ID":"f51e918c-72d1-41ce-bccb-04cf9571f9f8","Type":"ContainerStarted","Data":"6a4eb8449c8306aa16a699350e8a713464c3212fcf38f95ee454a5a754ea8998"} Jul 08 18:05:34.555296 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:34.555262 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qd8c6" event={"ID":"f51e918c-72d1-41ce-bccb-04cf9571f9f8","Type":"ContainerStarted","Data":"832120814a00f5eee3926e31da0fc974dbed28f2a37abcacddecdc61a159b106"} Jul 08 18:05:34.555665 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:34.555312 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qd8c6" event={"ID":"f51e918c-72d1-41ce-bccb-04cf9571f9f8","Type":"ContainerStarted","Data":"32820cf8058727e5a765895de943406cc49863abed9a537113db761052afc65c"} Jul 08 18:05:34.587111 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:34.587058 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qd8c6" podStartSLOduration=67.404683679 podStartE2EDuration="1m8.587040025s" totalImagesPullingTime="1.182356346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:34.585536354 +0000 UTC m=+68.829434521" watchObservedRunningTime="2026-07-08 18:05:34.587040025 +0000 UTC m=+68.830938182" Jul 08 18:05:36.526700 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:36.526665 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-66fq4" Jul 08 18:05:37.480590 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.480554 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8"] Jul 08 18:05:37.483073 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.483048 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8" Jul 08 18:05:37.488597 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.488573 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 18:05:37.488997 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.488965 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 08 18:05:37.489449 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.489427 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 08 18:05:37.489550 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.489487 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 18:05:37.489711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.489688 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-96dw2\"" Jul 08 18:05:37.492883 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.492866 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 18:05:37.509427 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.506919 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs"] Jul 08 18:05:37.510720 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.510693 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" Jul 08 18:05:37.514937 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.514908 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8"] Jul 08 18:05:37.515280 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.515253 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 08 18:05:37.515428 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.515412 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 08 18:05:37.515672 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.515655 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 08 18:05:37.515869 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.515852 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-smw94\"" Jul 08 18:05:37.543782 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.543749 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs"] Jul 08 18:05:37.577760 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.577727 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ec59eec4-a9bf-4bb4-8331-778068a820a2-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-rppgs\" (UID: \"ec59eec4-a9bf-4bb4-8331-778068a820a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" Jul 08 18:05:37.577760 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.577770 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/87e8fbf5-8160-4922-a15d-5c4429fef281-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-n52d8\" (UID: \"87e8fbf5-8160-4922-a15d-5c4429fef281\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8" Jul 08 18:05:37.577968 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.577792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec59eec4-a9bf-4bb4-8331-778068a820a2-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-rppgs\" (UID: \"ec59eec4-a9bf-4bb4-8331-778068a820a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" Jul 08 18:05:37.577968 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.577855 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec59eec4-a9bf-4bb4-8331-778068a820a2-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-rppgs\" (UID: \"ec59eec4-a9bf-4bb4-8331-778068a820a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" Jul 08 18:05:37.577968 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.577898 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ec59eec4-a9bf-4bb4-8331-778068a820a2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-rppgs\" (UID: \"ec59eec4-a9bf-4bb4-8331-778068a820a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" Jul 08 18:05:37.577968 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.577933 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87e8fbf5-8160-4922-a15d-5c4429fef281-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-n52d8\" (UID: \"87e8fbf5-8160-4922-a15d-5c4429fef281\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8" Jul 08 18:05:37.577968 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.577957 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtdfz\" (UniqueName: \"kubernetes.io/projected/87e8fbf5-8160-4922-a15d-5c4429fef281-kube-api-access-wtdfz\") pod \"openshift-state-metrics-54cf96dfcf-n52d8\" (UID: \"87e8fbf5-8160-4922-a15d-5c4429fef281\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8" Jul 08 18:05:37.578223 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.578019 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87e8fbf5-8160-4922-a15d-5c4429fef281-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-n52d8\" (UID: \"87e8fbf5-8160-4922-a15d-5c4429fef281\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8" Jul 08 18:05:37.578223 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.578131 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85mhf\" (UniqueName: \"kubernetes.io/projected/ec59eec4-a9bf-4bb4-8331-778068a820a2-kube-api-access-85mhf\") pod \"kube-state-metrics-7c9dbb8b7d-rppgs\" (UID: \"ec59eec4-a9bf-4bb4-8331-778068a820a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" Jul 08 18:05:37.578223 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.578165 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec59eec4-a9bf-4bb4-8331-778068a820a2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-rppgs\" (UID: \"ec59eec4-a9bf-4bb4-8331-778068a820a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" Jul 08 18:05:37.588560 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.588529 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b7dg6"] Jul 08 18:05:37.591307 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.591284 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.599423 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.599402 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 18:05:37.600513 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.600488 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 18:05:37.601290 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.601080 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 18:05:37.601615 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.601594 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xdrn7\"" Jul 08 18:05:37.679319 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.679287 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec59eec4-a9bf-4bb4-8331-778068a820a2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-rppgs\" (UID: \"ec59eec4-a9bf-4bb4-8331-778068a820a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" Jul 08 18:05:37.679490 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.679335 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/40e65754-2547-4c64-a6a0-28a0d8e1f863-node-exporter-wtmp\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.679490 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.679374 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40e65754-2547-4c64-a6a0-28a0d8e1f863-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.679490 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.679400 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/40e65754-2547-4c64-a6a0-28a0d8e1f863-node-exporter-accelerators-collector-config\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.679490 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.679433 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ec59eec4-a9bf-4bb4-8331-778068a820a2-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-rppgs\" (UID: \"ec59eec4-a9bf-4bb4-8331-778068a820a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" Jul 08 18:05:37.679698 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.679510 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/87e8fbf5-8160-4922-a15d-5c4429fef281-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-n52d8\" (UID: \"87e8fbf5-8160-4922-a15d-5c4429fef281\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8" Jul 08 18:05:37.679698 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.679541 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec59eec4-a9bf-4bb4-8331-778068a820a2-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-rppgs\" (UID: \"ec59eec4-a9bf-4bb4-8331-778068a820a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" Jul 08 18:05:37.679698 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.679570 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/40e65754-2547-4c64-a6a0-28a0d8e1f863-node-exporter-textfile\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.679698 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.679611 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec59eec4-a9bf-4bb4-8331-778068a820a2-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-rppgs\" (UID: \"ec59eec4-a9bf-4bb4-8331-778068a820a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" Jul 08 18:05:37.679884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.679801 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ec59eec4-a9bf-4bb4-8331-778068a820a2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-rppgs\" (UID: \"ec59eec4-a9bf-4bb4-8331-778068a820a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" Jul 08 18:05:37.679884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.679863 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ec59eec4-a9bf-4bb4-8331-778068a820a2-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-rppgs\" (UID: \"ec59eec4-a9bf-4bb4-8331-778068a820a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" Jul 08 18:05:37.679987 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.679934 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/40e65754-2547-4c64-a6a0-28a0d8e1f863-node-exporter-tls\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.680073 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.679980 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87e8fbf5-8160-4922-a15d-5c4429fef281-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-n52d8\" (UID: \"87e8fbf5-8160-4922-a15d-5c4429fef281\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8" Jul 08 18:05:37.680073 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.680014 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtdfz\" (UniqueName: \"kubernetes.io/projected/87e8fbf5-8160-4922-a15d-5c4429fef281-kube-api-access-wtdfz\") pod \"openshift-state-metrics-54cf96dfcf-n52d8\" (UID: \"87e8fbf5-8160-4922-a15d-5c4429fef281\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8" Jul 08 18:05:37.680073 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.680059 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40e65754-2547-4c64-a6a0-28a0d8e1f863-sys\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.680177 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.680094 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87e8fbf5-8160-4922-a15d-5c4429fef281-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-n52d8\" (UID: \"87e8fbf5-8160-4922-a15d-5c4429fef281\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8" Jul 08 18:05:37.680177 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.680126 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/40e65754-2547-4c64-a6a0-28a0d8e1f863-root\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.680177 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.680153 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85mhf\" (UniqueName: \"kubernetes.io/projected/ec59eec4-a9bf-4bb4-8331-778068a820a2-kube-api-access-85mhf\") pod \"kube-state-metrics-7c9dbb8b7d-rppgs\" (UID: \"ec59eec4-a9bf-4bb4-8331-778068a820a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" Jul 08 18:05:37.680281 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.680176 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40e65754-2547-4c64-a6a0-28a0d8e1f863-metrics-client-ca\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.680281 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.680202 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqtfh\" (UniqueName: \"kubernetes.io/projected/40e65754-2547-4c64-a6a0-28a0d8e1f863-kube-api-access-bqtfh\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.680420 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.680400 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec59eec4-a9bf-4bb4-8331-778068a820a2-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-rppgs\" (UID: \"ec59eec4-a9bf-4bb4-8331-778068a820a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" Jul 08 18:05:37.680464 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.680411 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ec59eec4-a9bf-4bb4-8331-778068a820a2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-rppgs\" (UID: \"ec59eec4-a9bf-4bb4-8331-778068a820a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" Jul 08 18:05:37.680711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.680683 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87e8fbf5-8160-4922-a15d-5c4429fef281-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-n52d8\" (UID: \"87e8fbf5-8160-4922-a15d-5c4429fef281\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8" Jul 08 18:05:37.682865 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.682842 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/87e8fbf5-8160-4922-a15d-5c4429fef281-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-n52d8\" (UID: \"87e8fbf5-8160-4922-a15d-5c4429fef281\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8" Jul 08 18:05:37.682950 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.682933 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec59eec4-a9bf-4bb4-8331-778068a820a2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-rppgs\" (UID: \"ec59eec4-a9bf-4bb4-8331-778068a820a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" Jul 08 18:05:37.683409 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.683390 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec59eec4-a9bf-4bb4-8331-778068a820a2-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-rppgs\" (UID: \"ec59eec4-a9bf-4bb4-8331-778068a820a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" Jul 08 18:05:37.683503 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.683481 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87e8fbf5-8160-4922-a15d-5c4429fef281-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-n52d8\" (UID: \"87e8fbf5-8160-4922-a15d-5c4429fef281\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8" Jul 08 18:05:37.697331 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.697299 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtdfz\" (UniqueName: \"kubernetes.io/projected/87e8fbf5-8160-4922-a15d-5c4429fef281-kube-api-access-wtdfz\") pod \"openshift-state-metrics-54cf96dfcf-n52d8\" (UID: \"87e8fbf5-8160-4922-a15d-5c4429fef281\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8" Jul 08 18:05:37.700783 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.700765 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85mhf\" (UniqueName: \"kubernetes.io/projected/ec59eec4-a9bf-4bb4-8331-778068a820a2-kube-api-access-85mhf\") pod \"kube-state-metrics-7c9dbb8b7d-rppgs\" (UID: \"ec59eec4-a9bf-4bb4-8331-778068a820a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" Jul 08 18:05:37.781142 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.781060 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/40e65754-2547-4c64-a6a0-28a0d8e1f863-root\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.781142 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.781096 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40e65754-2547-4c64-a6a0-28a0d8e1f863-metrics-client-ca\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.781142 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.781113 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqtfh\" (UniqueName: \"kubernetes.io/projected/40e65754-2547-4c64-a6a0-28a0d8e1f863-kube-api-access-bqtfh\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.781142 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.781139 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/40e65754-2547-4c64-a6a0-28a0d8e1f863-node-exporter-wtmp\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.781441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.781170 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40e65754-2547-4c64-a6a0-28a0d8e1f863-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.781441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.781171 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/40e65754-2547-4c64-a6a0-28a0d8e1f863-root\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.781441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.781199 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/40e65754-2547-4c64-a6a0-28a0d8e1f863-node-exporter-accelerators-collector-config\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.781441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.781241 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/40e65754-2547-4c64-a6a0-28a0d8e1f863-node-exporter-textfile\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.781441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.781270 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/40e65754-2547-4c64-a6a0-28a0d8e1f863-node-exporter-tls\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.781441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.781297 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/40e65754-2547-4c64-a6a0-28a0d8e1f863-node-exporter-wtmp\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.781441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.781303 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40e65754-2547-4c64-a6a0-28a0d8e1f863-sys\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.781441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.781417 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40e65754-2547-4c64-a6a0-28a0d8e1f863-sys\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.781820 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.781682 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40e65754-2547-4c64-a6a0-28a0d8e1f863-metrics-client-ca\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.781820 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.781712 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/40e65754-2547-4c64-a6a0-28a0d8e1f863-node-exporter-accelerators-collector-config\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.781820 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.781749 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/40e65754-2547-4c64-a6a0-28a0d8e1f863-node-exporter-textfile\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.784103 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.784079 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/40e65754-2547-4c64-a6a0-28a0d8e1f863-node-exporter-tls\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.784358 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.784341 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40e65754-2547-4c64-a6a0-28a0d8e1f863-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.793641 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.793616 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8" Jul 08 18:05:37.794533 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.794509 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqtfh\" (UniqueName: \"kubernetes.io/projected/40e65754-2547-4c64-a6a0-28a0d8e1f863-kube-api-access-bqtfh\") pod \"node-exporter-b7dg6\" (UID: \"40e65754-2547-4c64-a6a0-28a0d8e1f863\") " pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:37.821505 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.821485 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" Jul 08 18:05:37.902184 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:37.902157 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b7dg6" Jul 08 18:05:38.212619 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:05:38.212596 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40e65754_2547_4c64_a6a0_28a0d8e1f863.slice/crio-88fe5d2cea6e37865d08b3c2247a0e440b96c85de10a23f9100247ee0d2a3435 WatchSource:0}: Error finding container 88fe5d2cea6e37865d08b3c2247a0e440b96c85de10a23f9100247ee0d2a3435: Status 404 returned error can't find the container with id 88fe5d2cea6e37865d08b3c2247a0e440b96c85de10a23f9100247ee0d2a3435 Jul 08 18:05:38.274936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.274534 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f5fd9fcc6-k6hw5"] Jul 08 18:05:38.282397 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.282369 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:38.296257 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.295843 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 18:05:38.296257 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.295906 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 18:05:38.296257 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.295956 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cfz9t\"" Jul 08 18:05:38.296257 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.295848 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 18:05:38.296257 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.296197 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 18:05:38.299744 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.299289 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f5fd9fcc6-k6hw5"] Jul 08 18:05:38.301959 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.300147 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 18:05:38.301959 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.300511 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 18:05:38.317391 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.317366 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 18:05:38.380180 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.380156 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs"] Jul 08 18:05:38.381503 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:05:38.381478 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec59eec4_a9bf_4bb4_8331_778068a820a2.slice/crio-26e5ad83e5eda15fb17708912eef4af9eaa2f25993e0d567f9013cce3c9d4375 WatchSource:0}: Error finding container 26e5ad83e5eda15fb17708912eef4af9eaa2f25993e0d567f9013cce3c9d4375: Status 404 returned error can't find the container with id 26e5ad83e5eda15fb17708912eef4af9eaa2f25993e0d567f9013cce3c9d4375 Jul 08 18:05:38.386525 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.386262 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-console-oauth-config\") pod \"console-f5fd9fcc6-k6hw5\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:38.386525 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.386301 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-service-ca\") pod \"console-f5fd9fcc6-k6hw5\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:38.386525 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.386352 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-oauth-serving-cert\") pod \"console-f5fd9fcc6-k6hw5\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:38.386525 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.386398 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz2ql\" (UniqueName: \"kubernetes.io/projected/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-kube-api-access-tz2ql\") pod \"console-f5fd9fcc6-k6hw5\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:38.386525 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.386430 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-console-serving-cert\") pod \"console-f5fd9fcc6-k6hw5\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:38.386525 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.386471 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-console-config\") pod \"console-f5fd9fcc6-k6hw5\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:38.387938 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.387908 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8"] Jul 08 18:05:38.487226 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.487203 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-console-oauth-config\") pod \"console-f5fd9fcc6-k6hw5\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:38.487360 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.487235 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-service-ca\") pod \"console-f5fd9fcc6-k6hw5\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:38.487360 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.487263 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-oauth-serving-cert\") pod \"console-f5fd9fcc6-k6hw5\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:38.487360 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.487278 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz2ql\" (UniqueName: \"kubernetes.io/projected/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-kube-api-access-tz2ql\") pod \"console-f5fd9fcc6-k6hw5\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:38.487507 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.487393 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-console-serving-cert\") pod \"console-f5fd9fcc6-k6hw5\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:38.487507 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.487443 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-console-config\") pod \"console-f5fd9fcc6-k6hw5\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:38.488163 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.488136 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-service-ca\") pod \"console-f5fd9fcc6-k6hw5\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:38.488343 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.488304 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-oauth-serving-cert\") pod \"console-f5fd9fcc6-k6hw5\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:38.488403 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.488342 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-console-config\") pod \"console-f5fd9fcc6-k6hw5\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:38.490118 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.489946 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-console-oauth-config\") pod \"console-f5fd9fcc6-k6hw5\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:38.490118 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.490091 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-console-serving-cert\") pod \"console-f5fd9fcc6-k6hw5\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:38.519560 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.519534 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz2ql\" (UniqueName: \"kubernetes.io/projected/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-kube-api-access-tz2ql\") pod \"console-f5fd9fcc6-k6hw5\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:38.575441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.575403 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b7dg6" event={"ID":"40e65754-2547-4c64-a6a0-28a0d8e1f863","Type":"ContainerStarted","Data":"88fe5d2cea6e37865d08b3c2247a0e440b96c85de10a23f9100247ee0d2a3435"} Jul 08 18:05:38.577087 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.577058 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nqpg2" event={"ID":"ab615a98-2754-4748-8f58-fbfecce973bd","Type":"ContainerStarted","Data":"029eb2e2846518411744b11f6be52ee98513db67fc308212b20a2bdd07407f7d"} Jul 08 18:05:38.577350 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.577330 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:05:38.579155 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.579129 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8" event={"ID":"87e8fbf5-8160-4922-a15d-5c4429fef281","Type":"ContainerStarted","Data":"ff78e3fbc37f492a5a82f91d5c9c3242a067dd776fdff2deb4f952fbe6881300"} Jul 08 18:05:38.579243 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.579176 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8" event={"ID":"87e8fbf5-8160-4922-a15d-5c4429fef281","Type":"ContainerStarted","Data":"1798092ffb431196520a894b6c750de123b28f190bb84f936cbb1c2c47121425"} Jul 08 18:05:38.579243 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.579194 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8" event={"ID":"87e8fbf5-8160-4922-a15d-5c4429fef281","Type":"ContainerStarted","Data":"835d96a65fafcfffeda7450b75a42cf274f643d8dc4eb4e0e7bf2942f8a1cec3"} Jul 08 18:05:38.580252 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.580213 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" event={"ID":"ec59eec4-a9bf-4bb4-8331-778068a820a2","Type":"ContainerStarted","Data":"26e5ad83e5eda15fb17708912eef4af9eaa2f25993e0d567f9013cce3c9d4375"} Jul 08 18:05:38.581920 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.581895 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rj4rd" event={"ID":"d43bf8f7-16a4-4595-8185-6de3d1880faf","Type":"ContainerStarted","Data":"424012ca97b5bbf26ed747254357517d79d26a6d2c9c573bb27881c8e6ebb95c"} Jul 08 18:05:38.598839 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.598819 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:38.611279 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.611237 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nqpg2" podStartSLOduration=66.896271128 podStartE2EDuration="1m12.611223487s" totalImagesPullingTime="5.714952359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:38.610571018 +0000 UTC m=+72.854469208" watchObservedRunningTime="2026-07-08 18:05:38.611223487 +0000 UTC m=+72.855121661" Jul 08 18:05:38.657065 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.656996 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rj4rd" podStartSLOduration=66.93153122 podStartE2EDuration="1m12.656978859s" totalImagesPullingTime="5.725447639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:38.65665666 +0000 UTC m=+72.900554826" watchObservedRunningTime="2026-07-08 18:05:38.656978859 +0000 UTC m=+72.900877026" Jul 08 18:05:38.851448 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:38.851423 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f5fd9fcc6-k6hw5"] Jul 08 18:05:38.853568 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:05:38.853543 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8164b9cd_f395_41a5_a12b_1a61ec19a3d8.slice/crio-d076d077a352ca343bccd9e0fccccaab73c5ed2487da19282663af9b0a7da590 WatchSource:0}: Error finding container d076d077a352ca343bccd9e0fccccaab73c5ed2487da19282663af9b0a7da590: Status 404 returned error can't find the container with id d076d077a352ca343bccd9e0fccccaab73c5ed2487da19282663af9b0a7da590 Jul 08 18:05:39.590974 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:39.590887 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f5fd9fcc6-k6hw5" event={"ID":"8164b9cd-f395-41a5-a12b-1a61ec19a3d8","Type":"ContainerStarted","Data":"d076d077a352ca343bccd9e0fccccaab73c5ed2487da19282663af9b0a7da590"} Jul 08 18:05:40.419298 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:40.419117 2574 patch_prober.go:28] interesting pod/image-registry-58b7c645bc-fvjx2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 18:05:40.419298 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:40.419194 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" podUID="10ed572b-9033-483f-ac88-a23fc874b33c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 18:05:40.598156 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:40.598059 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8" event={"ID":"87e8fbf5-8160-4922-a15d-5c4429fef281","Type":"ContainerStarted","Data":"2a84e4f5f08ad7a0cdb116b13c72a9f06daafe592142e429eb282ff050f6515f"} Jul 08 18:05:40.602187 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:40.602140 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" event={"ID":"ec59eec4-a9bf-4bb4-8331-778068a820a2","Type":"ContainerStarted","Data":"33ca707a0e4d729821f079ff46826f5b488b989a4e11d026fb7b443108832ff1"} Jul 08 18:05:40.602351 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:40.602202 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" event={"ID":"ec59eec4-a9bf-4bb4-8331-778068a820a2","Type":"ContainerStarted","Data":"044c00f88283a4f8b590137ce9ea8754471a488e823ff3f1a6684c5438b6cbbf"} Jul 08 18:05:40.602351 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:40.602234 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" event={"ID":"ec59eec4-a9bf-4bb4-8331-778068a820a2","Type":"ContainerStarted","Data":"3c738b4ce355470fa16a4d55bad100d12f3df2f7771cab368d67aa132c1294f1"} Jul 08 18:05:40.622915 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:40.622865 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-n52d8" podStartSLOduration=1.9814107 podStartE2EDuration="3.622846069s" totalImagesPullingTime="1.641435369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:05:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:40.62199695 +0000 UTC m=+74.865895116" watchObservedRunningTime="2026-07-08 18:05:40.622846069 +0000 UTC m=+74.866744236" Jul 08 18:05:40.653391 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:40.653337 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rppgs" podStartSLOduration=1.8316307680000001 podStartE2EDuration="3.653316881s" totalImagesPullingTime="1.821686113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:05:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:40.652172098 +0000 UTC m=+74.896070290" watchObservedRunningTime="2026-07-08 18:05:40.653316881 +0000 UTC m=+74.897215047" Jul 08 18:05:42.046137 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.046107 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7695869b89-2vzc2"] Jul 08 18:05:42.049237 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.049215 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.052468 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.052428 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 18:05:42.052592 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.052428 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 08 18:05:42.052689 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.052674 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zcq4p\"" Jul 08 18:05:42.054055 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.054018 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bumk0ocn28j2g\"" Jul 08 18:05:42.054157 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.054082 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 08 18:05:42.054221 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.054157 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 08 18:05:42.062774 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.062755 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7695869b89-2vzc2"] Jul 08 18:05:42.116618 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.116596 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-secret-metrics-server-client-certs\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.116711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.116631 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z9dh\" (UniqueName: \"kubernetes.io/projected/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-kube-api-access-8z9dh\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.116711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.116673 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-metrics-server-audit-profiles\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.116784 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.116761 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.116835 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.116818 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-secret-metrics-server-tls\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.116903 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.116850 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-client-ca-bundle\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.116903 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.116881 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-audit-log\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.218196 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.218164 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-secret-metrics-server-client-certs\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.218305 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.218203 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z9dh\" (UniqueName: \"kubernetes.io/projected/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-kube-api-access-8z9dh\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.218305 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.218253 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-metrics-server-audit-profiles\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.218305 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.218299 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.218460 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.218332 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-secret-metrics-server-tls\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.218460 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.218365 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-client-ca-bundle\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.218566 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.218535 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-audit-log\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.218928 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.218901 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-audit-log\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.219197 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.218996 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.219298 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.219276 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-metrics-server-audit-profiles\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.220454 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.220437 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-secret-metrics-server-client-certs\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.221180 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.221159 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-secret-metrics-server-tls\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.221251 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.221205 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-client-ca-bundle\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.246620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.246596 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z9dh\" (UniqueName: \"kubernetes.io/projected/b8f8bbf3-facd-484a-8b30-cfc67b85d4c5-kube-api-access-8z9dh\") pod \"metrics-server-7695869b89-2vzc2\" (UID: \"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5\") " pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.372111 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.372062 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:05:42.531379 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.531305 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7695869b89-2vzc2"] Jul 08 18:05:42.533860 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:05:42.533829 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f8bbf3_facd_484a_8b30_cfc67b85d4c5.slice/crio-e5a7ae2009498b70c3405a6aaecf1349567b8103ed63a54ceb51f371af957ec4 WatchSource:0}: Error finding container e5a7ae2009498b70c3405a6aaecf1349567b8103ed63a54ceb51f371af957ec4: Status 404 returned error can't find the container with id e5a7ae2009498b70c3405a6aaecf1349567b8103ed63a54ceb51f371af957ec4 Jul 08 18:05:42.610682 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.610650 2574 generic.go:356] "Generic (PLEG): container finished" podID="40e65754-2547-4c64-a6a0-28a0d8e1f863" containerID="de4c3c627c02cf2cbf41e02acdbf4c560d633cf847ba7708edf6ac994a5b94ed" exitCode=0 Jul 08 18:05:42.610780 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.610729 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b7dg6" event={"ID":"40e65754-2547-4c64-a6a0-28a0d8e1f863","Type":"ContainerDied","Data":"de4c3c627c02cf2cbf41e02acdbf4c560d633cf847ba7708edf6ac994a5b94ed"} Jul 08 18:05:42.611893 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.611852 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" event={"ID":"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5","Type":"ContainerStarted","Data":"e5a7ae2009498b70c3405a6aaecf1349567b8103ed63a54ceb51f371af957ec4"} Jul 08 18:05:42.613379 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:42.613355 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f5fd9fcc6-k6hw5" event={"ID":"8164b9cd-f395-41a5-a12b-1a61ec19a3d8","Type":"ContainerStarted","Data":"29da05aa3e8ae804c085501d6634472609f67eb3dea66cb09340ed9edad27cda"} Jul 08 18:05:43.509727 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:43.509697 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58b7c645bc-fvjx2" Jul 08 18:05:43.540942 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:43.540880 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f5fd9fcc6-k6hw5" podStartSLOduration=2.315501408 podStartE2EDuration="5.540838032s" totalImagesPullingTime="3.225336624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:05:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:42.670542256 +0000 UTC m=+76.914440422" watchObservedRunningTime="2026-07-08 18:05:43.540838032 +0000 UTC m=+77.784736197" Jul 08 18:05:43.620464 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:43.620432 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b7dg6" event={"ID":"40e65754-2547-4c64-a6a0-28a0d8e1f863","Type":"ContainerStarted","Data":"06128f198b7035cf3117600340430f406c6bfc68a8eb0f37162ba0a004482697"} Jul 08 18:05:43.620631 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:43.620498 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b7dg6" event={"ID":"40e65754-2547-4c64-a6a0-28a0d8e1f863","Type":"ContainerStarted","Data":"d26bbcd7708a500386cc0ac0cb8d950a071014be5ee7e87a877f5b73dc8d2bfb"} Jul 08 18:05:43.677433 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:43.677379 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b7dg6" podStartSLOduration=3.825894808 podStartE2EDuration="6.677359939s" totalImagesPullingTime="2.776728184s" totalInitContainerRuntime="74.736947ms" isStatefulPod=true podCreationTimestamp="2026-07-08 18:05:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:43.676119175 +0000 UTC m=+77.920017364" watchObservedRunningTime="2026-07-08 18:05:43.677359939 +0000 UTC m=+77.921258105" Jul 08 18:05:44.625382 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:44.625291 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" event={"ID":"b8f8bbf3-facd-484a-8b30-cfc67b85d4c5","Type":"ContainerStarted","Data":"00196cc9599d5e81357cc5e824f6747e1c86129c4efc19acf27c58cb435a4996"} Jul 08 18:05:44.649941 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:44.649894 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" podStartSLOduration=0.979104924 podStartE2EDuration="2.649879738s" totalImagesPullingTime="1.670774814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:05:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:44.648995971 +0000 UTC m=+78.892894137" watchObservedRunningTime="2026-07-08 18:05:44.649879738 +0000 UTC m=+78.893777965" Jul 08 18:05:48.599202 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:48.599065 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:48.599202 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:48.599144 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:48.604201 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:48.604171 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:48.641205 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:48.641176 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:05:49.867447 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:49.867406 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74bf7b776b-972bz"] Jul 08 18:05:49.871195 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:49.871175 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:49.883950 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:49.883926 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 08 18:05:49.907198 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:49.907174 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74bf7b776b-972bz"] Jul 08 18:05:49.974446 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:49.974421 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-trusted-ca-bundle\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:49.974548 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:49.974452 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-oauth-serving-cert\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:49.974548 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:49.974477 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9crjl\" (UniqueName: \"kubernetes.io/projected/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-kube-api-access-9crjl\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:49.974548 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:49.974498 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-console-serving-cert\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:49.974548 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:49.974514 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-console-config\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:49.974548 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:49.974537 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-service-ca\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:49.974746 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:49.974566 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-console-oauth-config\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:50.075840 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:50.075815 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-service-ca\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:50.075935 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:50.075846 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-console-oauth-config\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:50.075935 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:50.075879 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-trusted-ca-bundle\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:50.075935 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:50.075901 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-oauth-serving-cert\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:50.075935 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:50.075917 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9crjl\" (UniqueName: \"kubernetes.io/projected/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-kube-api-access-9crjl\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:50.076174 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:50.075947 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-console-serving-cert\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:50.076174 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:50.075971 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-console-config\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:50.076713 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:50.076686 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-console-config\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:50.076850 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:50.076726 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-service-ca\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:50.076910 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:50.076804 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-oauth-serving-cert\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:50.076910 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:50.076819 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-trusted-ca-bundle\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:50.078548 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:50.078527 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-console-oauth-config\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:50.078751 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:50.078728 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-console-serving-cert\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:50.091407 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:50.091381 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9crjl\" (UniqueName: \"kubernetes.io/projected/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-kube-api-access-9crjl\") pod \"console-74bf7b776b-972bz\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:50.181001 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:50.180979 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:05:50.321978 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:05:50.321948 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod538a78d3_1dcc_4869_b6c6_1a3a7c40dac9.slice/crio-3888996f6f97c9fc27fb09eefd034a3a25eb46a80d7cb049e5e969b60b4852af WatchSource:0}: Error finding container 3888996f6f97c9fc27fb09eefd034a3a25eb46a80d7cb049e5e969b60b4852af: Status 404 returned error can't find the container with id 3888996f6f97c9fc27fb09eefd034a3a25eb46a80d7cb049e5e969b60b4852af Jul 08 18:05:50.323413 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:50.323391 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74bf7b776b-972bz"] Jul 08 18:05:50.646895 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:50.646816 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74bf7b776b-972bz" event={"ID":"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9","Type":"ContainerStarted","Data":"8ca3a9cd6c7e8d732ca7d2d9a5c106b82d2159ad0bdfdfad812f9f457e2d70df"} Jul 08 18:05:50.646895 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:05:50.646864 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74bf7b776b-972bz" event={"ID":"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9","Type":"ContainerStarted","Data":"3888996f6f97c9fc27fb09eefd034a3a25eb46a80d7cb049e5e969b60b4852af"} Jul 08 18:06:00.181092 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:00.181058 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:06:00.181603 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:00.181121 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:06:00.185914 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:00.185889 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:06:00.217580 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:00.217527 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74bf7b776b-972bz" podStartSLOduration=11.217512762 podStartE2EDuration="11.217512762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:05:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:50.686296292 +0000 UTC m=+84.930194457" watchObservedRunningTime="2026-07-08 18:06:00.217512762 +0000 UTC m=+94.461411001" Jul 08 18:06:00.688945 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:00.688917 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:06:00.790990 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:00.790952 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f5fd9fcc6-k6hw5"] Jul 08 18:06:02.372949 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:02.372918 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:06:02.373327 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:02.372968 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:06:09.593413 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:09.593380 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nqpg2" Jul 08 18:06:10.265104 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:10.265075 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l8ggh_82f820f2-a049-41be-a661-f822def1a3ea/serve-healthcheck-canary/0.log" Jul 08 18:06:22.382313 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:22.382257 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:06:22.387257 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:22.387231 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7695869b89-2vzc2" Jul 08 18:06:25.811968 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:25.811887 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f5fd9fcc6-k6hw5" podUID="8164b9cd-f395-41a5-a12b-1a61ec19a3d8" containerName="console" containerID="cri-o://29da05aa3e8ae804c085501d6634472609f67eb3dea66cb09340ed9edad27cda" gracePeriod=15 Jul 08 18:06:26.043336 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.043313 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:06:26.137759 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.137703 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tz2ql\" (UniqueName: \"kubernetes.io/projected/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-kube-api-access-tz2ql\") pod \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " Jul 08 18:06:26.137759 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.137743 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-console-config\") pod \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " Jul 08 18:06:26.137910 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.137780 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-console-oauth-config\") pod \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " Jul 08 18:06:26.137975 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.137954 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-console-serving-cert\") pod \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " Jul 08 18:06:26.138049 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.138011 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-service-ca\") pod \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " Jul 08 18:06:26.138111 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.138048 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-console-config" (OuterVolumeSpecName: "console-config") pod "8164b9cd-f395-41a5-a12b-1a61ec19a3d8" (UID: "8164b9cd-f395-41a5-a12b-1a61ec19a3d8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:06:26.138111 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.138077 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-oauth-serving-cert\") pod \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\" (UID: \"8164b9cd-f395-41a5-a12b-1a61ec19a3d8\") " Jul 08 18:06:26.138283 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.138261 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-console-config\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:06:26.138395 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.138372 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8164b9cd-f395-41a5-a12b-1a61ec19a3d8" (UID: "8164b9cd-f395-41a5-a12b-1a61ec19a3d8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:06:26.138597 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.138573 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-service-ca" (OuterVolumeSpecName: "service-ca") pod "8164b9cd-f395-41a5-a12b-1a61ec19a3d8" (UID: "8164b9cd-f395-41a5-a12b-1a61ec19a3d8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:06:26.140055 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.140005 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-kube-api-access-tz2ql" (OuterVolumeSpecName: "kube-api-access-tz2ql") pod "8164b9cd-f395-41a5-a12b-1a61ec19a3d8" (UID: "8164b9cd-f395-41a5-a12b-1a61ec19a3d8"). InnerVolumeSpecName "kube-api-access-tz2ql". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:06:26.140055 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.140040 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8164b9cd-f395-41a5-a12b-1a61ec19a3d8" (UID: "8164b9cd-f395-41a5-a12b-1a61ec19a3d8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:06:26.140210 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.140193 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8164b9cd-f395-41a5-a12b-1a61ec19a3d8" (UID: "8164b9cd-f395-41a5-a12b-1a61ec19a3d8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:06:26.239104 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.239085 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-console-serving-cert\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:06:26.239104 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.239106 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-service-ca\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:06:26.239224 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.239116 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-oauth-serving-cert\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:06:26.239224 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.239125 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz2ql\" (UniqueName: \"kubernetes.io/projected/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-kube-api-access-tz2ql\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:06:26.239224 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.239133 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8164b9cd-f395-41a5-a12b-1a61ec19a3d8-console-oauth-config\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:06:26.785826 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.785795 2574 generic.go:356] "Generic (PLEG): container finished" podID="8164b9cd-f395-41a5-a12b-1a61ec19a3d8" containerID="29da05aa3e8ae804c085501d6634472609f67eb3dea66cb09340ed9edad27cda" exitCode=0 Jul 08 18:06:26.785926 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.785843 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f5fd9fcc6-k6hw5" Jul 08 18:06:26.785926 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.785875 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f5fd9fcc6-k6hw5" event={"ID":"8164b9cd-f395-41a5-a12b-1a61ec19a3d8","Type":"ContainerDied","Data":"29da05aa3e8ae804c085501d6634472609f67eb3dea66cb09340ed9edad27cda"} Jul 08 18:06:26.785926 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.785920 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f5fd9fcc6-k6hw5" event={"ID":"8164b9cd-f395-41a5-a12b-1a61ec19a3d8","Type":"ContainerDied","Data":"d076d077a352ca343bccd9e0fccccaab73c5ed2487da19282663af9b0a7da590"} Jul 08 18:06:26.786074 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.785943 2574 scope.go:117] "RemoveContainer" containerID="29da05aa3e8ae804c085501d6634472609f67eb3dea66cb09340ed9edad27cda" Jul 08 18:06:26.794316 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.794287 2574 scope.go:117] "RemoveContainer" containerID="29da05aa3e8ae804c085501d6634472609f67eb3dea66cb09340ed9edad27cda" Jul 08 18:06:26.794610 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:06:26.794582 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29da05aa3e8ae804c085501d6634472609f67eb3dea66cb09340ed9edad27cda\": container with ID starting with 29da05aa3e8ae804c085501d6634472609f67eb3dea66cb09340ed9edad27cda not found: ID does not exist" containerID="29da05aa3e8ae804c085501d6634472609f67eb3dea66cb09340ed9edad27cda" Jul 08 18:06:26.794652 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.794611 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29da05aa3e8ae804c085501d6634472609f67eb3dea66cb09340ed9edad27cda"} err="failed to get container status \"29da05aa3e8ae804c085501d6634472609f67eb3dea66cb09340ed9edad27cda\": rpc error: code = NotFound desc = could not find container \"29da05aa3e8ae804c085501d6634472609f67eb3dea66cb09340ed9edad27cda\": container with ID starting with 29da05aa3e8ae804c085501d6634472609f67eb3dea66cb09340ed9edad27cda not found: ID does not exist" Jul 08 18:06:26.830740 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.830714 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f5fd9fcc6-k6hw5"] Jul 08 18:06:26.845381 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:26.845358 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f5fd9fcc6-k6hw5"] Jul 08 18:06:28.270671 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:06:28.270632 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8164b9cd-f395-41a5-a12b-1a61ec19a3d8" path="/var/lib/kubelet/pods/8164b9cd-f395-41a5-a12b-1a61ec19a3d8/volumes" Jul 08 18:07:31.893364 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:31.893326 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fc95b67c8-ndrxb"] Jul 08 18:07:31.893810 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:31.893579 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8164b9cd-f395-41a5-a12b-1a61ec19a3d8" containerName="console" Jul 08 18:07:31.893810 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:31.893590 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8164b9cd-f395-41a5-a12b-1a61ec19a3d8" containerName="console" Jul 08 18:07:31.893810 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:31.893641 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8164b9cd-f395-41a5-a12b-1a61ec19a3d8" containerName="console" Jul 08 18:07:31.896762 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:31.896743 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:31.918671 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:31.918649 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc95b67c8-ndrxb"] Jul 08 18:07:31.978441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:31.978419 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-console-oauth-config\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:31.978552 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:31.978448 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-service-ca\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:31.978552 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:31.978480 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-console-config\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:31.978552 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:31.978531 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-console-serving-cert\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:31.978708 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:31.978573 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-trusted-ca-bundle\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:31.978708 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:31.978620 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-oauth-serving-cert\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:31.978708 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:31.978653 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q9vb\" (UniqueName: \"kubernetes.io/projected/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-kube-api-access-6q9vb\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:32.079810 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:32.079785 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-service-ca\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:32.079912 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:32.079825 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-console-config\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:32.079912 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:32.079850 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-console-serving-cert\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:32.080019 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:32.079962 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-trusted-ca-bundle\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:32.080019 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:32.079995 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-oauth-serving-cert\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:32.080152 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:32.080050 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q9vb\" (UniqueName: \"kubernetes.io/projected/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-kube-api-access-6q9vb\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:32.080152 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:32.080083 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-console-oauth-config\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:32.080594 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:32.080563 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-service-ca\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:32.080669 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:32.080597 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-console-config\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:32.080710 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:32.080686 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-oauth-serving-cert\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:32.080800 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:32.080782 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-trusted-ca-bundle\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:32.082343 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:32.082320 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-console-serving-cert\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:32.082643 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:32.082621 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-console-oauth-config\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:32.091509 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:32.091486 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q9vb\" (UniqueName: \"kubernetes.io/projected/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-kube-api-access-6q9vb\") pod \"console-fc95b67c8-ndrxb\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:32.205628 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:32.205603 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:32.343646 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:32.343621 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc95b67c8-ndrxb"] Jul 08 18:07:32.345538 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:07:32.345504 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2aa2ef4_b9f0_4eb7_aaa5_42c5d96f727b.slice/crio-0b65f0a01667dea7702f50fdd59a5cdfaccc3e1907ed6c188e75277d7e1fcaef WatchSource:0}: Error finding container 0b65f0a01667dea7702f50fdd59a5cdfaccc3e1907ed6c188e75277d7e1fcaef: Status 404 returned error can't find the container with id 0b65f0a01667dea7702f50fdd59a5cdfaccc3e1907ed6c188e75277d7e1fcaef Jul 08 18:07:33.034425 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:33.034378 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc95b67c8-ndrxb" event={"ID":"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b","Type":"ContainerStarted","Data":"dab139abed56eaa21a2c0244781b79c1407463668e8652ae2638d628fe955741"} Jul 08 18:07:33.034867 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:33.034455 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc95b67c8-ndrxb" event={"ID":"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b","Type":"ContainerStarted","Data":"0b65f0a01667dea7702f50fdd59a5cdfaccc3e1907ed6c188e75277d7e1fcaef"} Jul 08 18:07:33.062727 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:33.062669 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fc95b67c8-ndrxb" podStartSLOduration=2.062652349 podStartE2EDuration="2.062652349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:07:33.062534515 +0000 UTC m=+187.306432908" watchObservedRunningTime="2026-07-08 18:07:33.062652349 +0000 UTC m=+187.306550515" Jul 08 18:07:42.206700 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:42.206646 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:42.207290 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:42.206734 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:42.211595 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:42.211571 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:43.075236 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:43.075206 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:07:43.154079 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:07:43.154048 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74bf7b776b-972bz"] Jul 08 18:08:08.180126 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.180054 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-74bf7b776b-972bz" podUID="538a78d3-1dcc-4869-b6c6-1a3a7c40dac9" containerName="console" containerID="cri-o://8ca3a9cd6c7e8d732ca7d2d9a5c106b82d2159ad0bdfdfad812f9f457e2d70df" gracePeriod=15 Jul 08 18:08:08.418351 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.418328 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:08:08.523220 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.523170 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-oauth-serving-cert\") pod \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " Jul 08 18:08:08.523220 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.523196 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-service-ca\") pod \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " Jul 08 18:08:08.523413 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.523231 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-console-config\") pod \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " Jul 08 18:08:08.523413 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.523253 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-trusted-ca-bundle\") pod \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " Jul 08 18:08:08.523413 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.523316 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-console-oauth-config\") pod \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " Jul 08 18:08:08.523413 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.523343 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9crjl\" (UniqueName: \"kubernetes.io/projected/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-kube-api-access-9crjl\") pod \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " Jul 08 18:08:08.523413 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.523369 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-console-serving-cert\") pod \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\" (UID: \"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9\") " Jul 08 18:08:08.523698 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.523669 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "538a78d3-1dcc-4869-b6c6-1a3a7c40dac9" (UID: "538a78d3-1dcc-4869-b6c6-1a3a7c40dac9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:08:08.523816 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.523694 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-console-config" (OuterVolumeSpecName: "console-config") pod "538a78d3-1dcc-4869-b6c6-1a3a7c40dac9" (UID: "538a78d3-1dcc-4869-b6c6-1a3a7c40dac9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:08:08.523816 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.523706 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-service-ca" (OuterVolumeSpecName: "service-ca") pod "538a78d3-1dcc-4869-b6c6-1a3a7c40dac9" (UID: "538a78d3-1dcc-4869-b6c6-1a3a7c40dac9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:08:08.523816 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.523716 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "538a78d3-1dcc-4869-b6c6-1a3a7c40dac9" (UID: "538a78d3-1dcc-4869-b6c6-1a3a7c40dac9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:08:08.525609 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.525583 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-kube-api-access-9crjl" (OuterVolumeSpecName: "kube-api-access-9crjl") pod "538a78d3-1dcc-4869-b6c6-1a3a7c40dac9" (UID: "538a78d3-1dcc-4869-b6c6-1a3a7c40dac9"). InnerVolumeSpecName "kube-api-access-9crjl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:08:08.525718 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.525699 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "538a78d3-1dcc-4869-b6c6-1a3a7c40dac9" (UID: "538a78d3-1dcc-4869-b6c6-1a3a7c40dac9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:08:08.525806 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.525792 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "538a78d3-1dcc-4869-b6c6-1a3a7c40dac9" (UID: "538a78d3-1dcc-4869-b6c6-1a3a7c40dac9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:08:08.624324 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.624296 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-oauth-serving-cert\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:08:08.624324 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.624322 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-service-ca\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:08:08.624443 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.624331 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-console-config\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:08:08.624443 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.624339 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-trusted-ca-bundle\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:08:08.624443 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.624348 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-console-oauth-config\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:08:08.624443 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.624356 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9crjl\" (UniqueName: \"kubernetes.io/projected/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-kube-api-access-9crjl\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:08:08.624443 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:08.624365 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9-console-serving-cert\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:08:09.169245 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:09.169214 2574 generic.go:356] "Generic (PLEG): container finished" podID="538a78d3-1dcc-4869-b6c6-1a3a7c40dac9" containerID="8ca3a9cd6c7e8d732ca7d2d9a5c106b82d2159ad0bdfdfad812f9f457e2d70df" exitCode=0 Jul 08 18:08:09.169371 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:09.169272 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74bf7b776b-972bz" Jul 08 18:08:09.169371 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:09.169316 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74bf7b776b-972bz" event={"ID":"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9","Type":"ContainerDied","Data":"8ca3a9cd6c7e8d732ca7d2d9a5c106b82d2159ad0bdfdfad812f9f457e2d70df"} Jul 08 18:08:09.169461 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:09.169379 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74bf7b776b-972bz" event={"ID":"538a78d3-1dcc-4869-b6c6-1a3a7c40dac9","Type":"ContainerDied","Data":"3888996f6f97c9fc27fb09eefd034a3a25eb46a80d7cb049e5e969b60b4852af"} Jul 08 18:08:09.169461 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:09.169403 2574 scope.go:117] "RemoveContainer" containerID="8ca3a9cd6c7e8d732ca7d2d9a5c106b82d2159ad0bdfdfad812f9f457e2d70df" Jul 08 18:08:09.178754 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:09.178736 2574 scope.go:117] "RemoveContainer" containerID="8ca3a9cd6c7e8d732ca7d2d9a5c106b82d2159ad0bdfdfad812f9f457e2d70df" Jul 08 18:08:09.179018 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:08:09.178996 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ca3a9cd6c7e8d732ca7d2d9a5c106b82d2159ad0bdfdfad812f9f457e2d70df\": container with ID starting with 8ca3a9cd6c7e8d732ca7d2d9a5c106b82d2159ad0bdfdfad812f9f457e2d70df not found: ID does not exist" containerID="8ca3a9cd6c7e8d732ca7d2d9a5c106b82d2159ad0bdfdfad812f9f457e2d70df" Jul 08 18:08:09.179097 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:09.179057 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ca3a9cd6c7e8d732ca7d2d9a5c106b82d2159ad0bdfdfad812f9f457e2d70df"} err="failed to get container status \"8ca3a9cd6c7e8d732ca7d2d9a5c106b82d2159ad0bdfdfad812f9f457e2d70df\": rpc error: code = NotFound desc = could not find container \"8ca3a9cd6c7e8d732ca7d2d9a5c106b82d2159ad0bdfdfad812f9f457e2d70df\": container with ID starting with 8ca3a9cd6c7e8d732ca7d2d9a5c106b82d2159ad0bdfdfad812f9f457e2d70df not found: ID does not exist" Jul 08 18:08:09.192957 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:09.192930 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74bf7b776b-972bz"] Jul 08 18:08:09.201457 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:09.199571 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74bf7b776b-972bz"] Jul 08 18:08:10.269583 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:10.269548 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="538a78d3-1dcc-4869-b6c6-1a3a7c40dac9" path="/var/lib/kubelet/pods/538a78d3-1dcc-4869-b6c6-1a3a7c40dac9/volumes" Jul 08 18:08:37.325235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:37.325198 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng"] Jul 08 18:08:37.325690 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:37.325476 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="538a78d3-1dcc-4869-b6c6-1a3a7c40dac9" containerName="console" Jul 08 18:08:37.325690 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:37.325490 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="538a78d3-1dcc-4869-b6c6-1a3a7c40dac9" containerName="console" Jul 08 18:08:37.325690 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:37.325550 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="538a78d3-1dcc-4869-b6c6-1a3a7c40dac9" containerName="console" Jul 08 18:08:37.329715 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:37.329696 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng" Jul 08 18:08:37.332789 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:37.332762 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pqj58\"" Jul 08 18:08:37.332933 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:37.332809 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 18:08:37.333828 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:37.333811 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 18:08:37.340408 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:37.340384 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng"] Jul 08 18:08:37.415455 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:37.415427 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50140d3f-d17d-4d0e-9a0d-802b0f98430a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng\" (UID: \"50140d3f-d17d-4d0e-9a0d-802b0f98430a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng" Jul 08 18:08:37.415568 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:37.415464 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50140d3f-d17d-4d0e-9a0d-802b0f98430a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng\" (UID: \"50140d3f-d17d-4d0e-9a0d-802b0f98430a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng" Jul 08 18:08:37.415568 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:37.415497 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8css\" (UniqueName: \"kubernetes.io/projected/50140d3f-d17d-4d0e-9a0d-802b0f98430a-kube-api-access-s8css\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng\" (UID: \"50140d3f-d17d-4d0e-9a0d-802b0f98430a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng" Jul 08 18:08:37.516304 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:37.516279 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50140d3f-d17d-4d0e-9a0d-802b0f98430a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng\" (UID: \"50140d3f-d17d-4d0e-9a0d-802b0f98430a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng" Jul 08 18:08:37.516421 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:37.516313 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50140d3f-d17d-4d0e-9a0d-802b0f98430a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng\" (UID: \"50140d3f-d17d-4d0e-9a0d-802b0f98430a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng" Jul 08 18:08:37.516421 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:37.516344 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8css\" (UniqueName: \"kubernetes.io/projected/50140d3f-d17d-4d0e-9a0d-802b0f98430a-kube-api-access-s8css\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng\" (UID: \"50140d3f-d17d-4d0e-9a0d-802b0f98430a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng" Jul 08 18:08:37.516643 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:37.516620 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50140d3f-d17d-4d0e-9a0d-802b0f98430a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng\" (UID: \"50140d3f-d17d-4d0e-9a0d-802b0f98430a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng" Jul 08 18:08:37.516714 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:37.516690 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50140d3f-d17d-4d0e-9a0d-802b0f98430a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng\" (UID: \"50140d3f-d17d-4d0e-9a0d-802b0f98430a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng" Jul 08 18:08:37.526828 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:37.526791 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8css\" (UniqueName: \"kubernetes.io/projected/50140d3f-d17d-4d0e-9a0d-802b0f98430a-kube-api-access-s8css\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng\" (UID: \"50140d3f-d17d-4d0e-9a0d-802b0f98430a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng" Jul 08 18:08:37.639156 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:37.639104 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng" Jul 08 18:08:37.767648 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:37.767543 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng"] Jul 08 18:08:37.770256 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:08:37.770223 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50140d3f_d17d_4d0e_9a0d_802b0f98430a.slice/crio-ba9d1ad9a8cfb2424b1b3f0547e5906740d878d28b6cac728b58e1a9ae3c9c64 WatchSource:0}: Error finding container ba9d1ad9a8cfb2424b1b3f0547e5906740d878d28b6cac728b58e1a9ae3c9c64: Status 404 returned error can't find the container with id ba9d1ad9a8cfb2424b1b3f0547e5906740d878d28b6cac728b58e1a9ae3c9c64 Jul 08 18:08:38.273947 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:38.273913 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng" event={"ID":"50140d3f-d17d-4d0e-9a0d-802b0f98430a","Type":"ContainerStarted","Data":"ba9d1ad9a8cfb2424b1b3f0547e5906740d878d28b6cac728b58e1a9ae3c9c64"} Jul 08 18:08:50.315261 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:50.315222 2574 generic.go:356] "Generic (PLEG): container finished" podID="50140d3f-d17d-4d0e-9a0d-802b0f98430a" containerID="07c30a80e1f5deda003d8bc7ad04b141533c498ef1d316f4a2aa2fbd972079fb" exitCode=0 Jul 08 18:08:50.315676 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:50.315274 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng" event={"ID":"50140d3f-d17d-4d0e-9a0d-802b0f98430a","Type":"ContainerDied","Data":"07c30a80e1f5deda003d8bc7ad04b141533c498ef1d316f4a2aa2fbd972079fb"} Jul 08 18:08:53.328885 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:53.328845 2574 generic.go:356] "Generic (PLEG): container finished" podID="50140d3f-d17d-4d0e-9a0d-802b0f98430a" containerID="4099b265e65eb48b08febb3db1d91e90489b6077a050bc2fd13b6f30589c959d" exitCode=0 Jul 08 18:08:53.329267 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:08:53.328892 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng" event={"ID":"50140d3f-d17d-4d0e-9a0d-802b0f98430a","Type":"ContainerDied","Data":"4099b265e65eb48b08febb3db1d91e90489b6077a050bc2fd13b6f30589c959d"} Jul 08 18:09:02.371236 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:02.371196 2574 generic.go:356] "Generic (PLEG): container finished" podID="50140d3f-d17d-4d0e-9a0d-802b0f98430a" containerID="04b11ee7dd6b109ab73fd942242bcad952a00c08044c04c1d0d4f96bc3f33374" exitCode=0 Jul 08 18:09:02.371596 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:02.371270 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng" event={"ID":"50140d3f-d17d-4d0e-9a0d-802b0f98430a","Type":"ContainerDied","Data":"04b11ee7dd6b109ab73fd942242bcad952a00c08044c04c1d0d4f96bc3f33374"} Jul 08 18:09:03.495178 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:03.495156 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng" Jul 08 18:09:03.592782 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:03.592758 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50140d3f-d17d-4d0e-9a0d-802b0f98430a-bundle\") pod \"50140d3f-d17d-4d0e-9a0d-802b0f98430a\" (UID: \"50140d3f-d17d-4d0e-9a0d-802b0f98430a\") " Jul 08 18:09:03.592913 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:03.592810 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50140d3f-d17d-4d0e-9a0d-802b0f98430a-util\") pod \"50140d3f-d17d-4d0e-9a0d-802b0f98430a\" (UID: \"50140d3f-d17d-4d0e-9a0d-802b0f98430a\") " Jul 08 18:09:03.592913 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:03.592838 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8css\" (UniqueName: \"kubernetes.io/projected/50140d3f-d17d-4d0e-9a0d-802b0f98430a-kube-api-access-s8css\") pod \"50140d3f-d17d-4d0e-9a0d-802b0f98430a\" (UID: \"50140d3f-d17d-4d0e-9a0d-802b0f98430a\") " Jul 08 18:09:03.593459 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:03.593431 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50140d3f-d17d-4d0e-9a0d-802b0f98430a-bundle" (OuterVolumeSpecName: "bundle") pod "50140d3f-d17d-4d0e-9a0d-802b0f98430a" (UID: "50140d3f-d17d-4d0e-9a0d-802b0f98430a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:09:03.595142 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:03.595119 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50140d3f-d17d-4d0e-9a0d-802b0f98430a-kube-api-access-s8css" (OuterVolumeSpecName: "kube-api-access-s8css") pod "50140d3f-d17d-4d0e-9a0d-802b0f98430a" (UID: "50140d3f-d17d-4d0e-9a0d-802b0f98430a"). InnerVolumeSpecName "kube-api-access-s8css". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:09:03.597841 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:03.597818 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50140d3f-d17d-4d0e-9a0d-802b0f98430a-util" (OuterVolumeSpecName: "util") pod "50140d3f-d17d-4d0e-9a0d-802b0f98430a" (UID: "50140d3f-d17d-4d0e-9a0d-802b0f98430a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:09:03.693760 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:03.693741 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50140d3f-d17d-4d0e-9a0d-802b0f98430a-bundle\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:09:03.693760 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:03.693760 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50140d3f-d17d-4d0e-9a0d-802b0f98430a-util\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:09:03.693873 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:03.693770 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8css\" (UniqueName: \"kubernetes.io/projected/50140d3f-d17d-4d0e-9a0d-802b0f98430a-kube-api-access-s8css\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:09:04.380671 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:04.380640 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng" event={"ID":"50140d3f-d17d-4d0e-9a0d-802b0f98430a","Type":"ContainerDied","Data":"ba9d1ad9a8cfb2424b1b3f0547e5906740d878d28b6cac728b58e1a9ae3c9c64"} Jul 08 18:09:04.380671 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:04.380665 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fmmng" Jul 08 18:09:04.380814 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:04.380687 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba9d1ad9a8cfb2424b1b3f0547e5906740d878d28b6cac728b58e1a9ae3c9c64" Jul 08 18:09:10.766731 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:10.766703 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z8nzr"] Jul 08 18:09:10.767174 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:10.766934 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50140d3f-d17d-4d0e-9a0d-802b0f98430a" containerName="extract" Jul 08 18:09:10.767174 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:10.766945 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="50140d3f-d17d-4d0e-9a0d-802b0f98430a" containerName="extract" Jul 08 18:09:10.767174 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:10.766957 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50140d3f-d17d-4d0e-9a0d-802b0f98430a" containerName="pull" Jul 08 18:09:10.767174 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:10.766962 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="50140d3f-d17d-4d0e-9a0d-802b0f98430a" containerName="pull" Jul 08 18:09:10.767174 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:10.766971 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50140d3f-d17d-4d0e-9a0d-802b0f98430a" containerName="util" Jul 08 18:09:10.767174 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:10.766976 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="50140d3f-d17d-4d0e-9a0d-802b0f98430a" containerName="util" Jul 08 18:09:10.767174 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:10.767042 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="50140d3f-d17d-4d0e-9a0d-802b0f98430a" containerName="extract" Jul 08 18:09:10.770639 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:10.770623 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z8nzr" Jul 08 18:09:10.773272 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:10.773254 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 08 18:09:10.773418 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:10.773403 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-w7qlk\"" Jul 08 18:09:10.773460 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:10.773437 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:09:10.783108 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:10.783082 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z8nzr"] Jul 08 18:09:10.840114 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:10.840085 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49s7m\" (UniqueName: \"kubernetes.io/projected/dadbbcb6-0218-4da1-b05d-11c59d0ef658-kube-api-access-49s7m\") pod \"cert-manager-operator-controller-manager-55c444bf86-z8nzr\" (UID: \"dadbbcb6-0218-4da1-b05d-11c59d0ef658\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z8nzr" Jul 08 18:09:10.840217 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:10.840148 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dadbbcb6-0218-4da1-b05d-11c59d0ef658-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-z8nzr\" (UID: \"dadbbcb6-0218-4da1-b05d-11c59d0ef658\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z8nzr" Jul 08 18:09:10.941321 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:10.941295 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49s7m\" (UniqueName: \"kubernetes.io/projected/dadbbcb6-0218-4da1-b05d-11c59d0ef658-kube-api-access-49s7m\") pod \"cert-manager-operator-controller-manager-55c444bf86-z8nzr\" (UID: \"dadbbcb6-0218-4da1-b05d-11c59d0ef658\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z8nzr" Jul 08 18:09:10.941392 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:10.941340 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dadbbcb6-0218-4da1-b05d-11c59d0ef658-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-z8nzr\" (UID: \"dadbbcb6-0218-4da1-b05d-11c59d0ef658\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z8nzr" Jul 08 18:09:10.941665 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:10.941648 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dadbbcb6-0218-4da1-b05d-11c59d0ef658-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-z8nzr\" (UID: \"dadbbcb6-0218-4da1-b05d-11c59d0ef658\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z8nzr" Jul 08 18:09:10.950469 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:10.950444 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49s7m\" (UniqueName: \"kubernetes.io/projected/dadbbcb6-0218-4da1-b05d-11c59d0ef658-kube-api-access-49s7m\") pod \"cert-manager-operator-controller-manager-55c444bf86-z8nzr\" (UID: \"dadbbcb6-0218-4da1-b05d-11c59d0ef658\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z8nzr" Jul 08 18:09:11.079741 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:11.079672 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z8nzr" Jul 08 18:09:11.217225 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:11.217200 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z8nzr"] Jul 08 18:09:11.219780 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:09:11.219749 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddadbbcb6_0218_4da1_b05d_11c59d0ef658.slice/crio-85ffc9b19ff01327bcefc467bea57865a276bab62dc62e6a2a255203aaf8fcde WatchSource:0}: Error finding container 85ffc9b19ff01327bcefc467bea57865a276bab62dc62e6a2a255203aaf8fcde: Status 404 returned error can't find the container with id 85ffc9b19ff01327bcefc467bea57865a276bab62dc62e6a2a255203aaf8fcde Jul 08 18:09:11.412121 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:11.412056 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z8nzr" event={"ID":"dadbbcb6-0218-4da1-b05d-11c59d0ef658","Type":"ContainerStarted","Data":"85ffc9b19ff01327bcefc467bea57865a276bab62dc62e6a2a255203aaf8fcde"} Jul 08 18:09:13.424616 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:13.424576 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z8nzr" event={"ID":"dadbbcb6-0218-4da1-b05d-11c59d0ef658","Type":"ContainerStarted","Data":"dad1d9c9a9fca212652736b8e4f072f22bc7f024754585c9f4d9da5017ddeac0"} Jul 08 18:09:13.458395 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:13.458337 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z8nzr" podStartSLOduration=2.157633562 podStartE2EDuration="3.458315923s" totalImagesPullingTime="1.300682361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:09:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:09:13.456731358 +0000 UTC m=+287.700629544" watchObservedRunningTime="2026-07-08 18:09:13.458315923 +0000 UTC m=+287.702214090" Jul 08 18:09:14.502851 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.502818 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq"] Jul 08 18:09:14.505324 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.505302 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq" Jul 08 18:09:14.512678 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.512659 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pqj58\"" Jul 08 18:09:14.512786 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.512685 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 18:09:14.516718 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.516696 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 18:09:14.533835 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.533813 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq"] Jul 08 18:09:14.567464 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.567442 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pszmd\" (UniqueName: \"kubernetes.io/projected/589a69de-1447-4d64-afc4-9ba889a5f7dd-kube-api-access-pszmd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq\" (UID: \"589a69de-1447-4d64-afc4-9ba889a5f7dd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq" Jul 08 18:09:14.567572 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.567502 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/589a69de-1447-4d64-afc4-9ba889a5f7dd-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq\" (UID: \"589a69de-1447-4d64-afc4-9ba889a5f7dd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq" Jul 08 18:09:14.567572 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.567529 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/589a69de-1447-4d64-afc4-9ba889a5f7dd-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq\" (UID: \"589a69de-1447-4d64-afc4-9ba889a5f7dd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq" Jul 08 18:09:14.668503 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.668473 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pszmd\" (UniqueName: \"kubernetes.io/projected/589a69de-1447-4d64-afc4-9ba889a5f7dd-kube-api-access-pszmd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq\" (UID: \"589a69de-1447-4d64-afc4-9ba889a5f7dd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq" Jul 08 18:09:14.668608 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.668517 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/589a69de-1447-4d64-afc4-9ba889a5f7dd-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq\" (UID: \"589a69de-1447-4d64-afc4-9ba889a5f7dd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq" Jul 08 18:09:14.668608 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.668537 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/589a69de-1447-4d64-afc4-9ba889a5f7dd-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq\" (UID: \"589a69de-1447-4d64-afc4-9ba889a5f7dd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq" Jul 08 18:09:14.668847 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.668831 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/589a69de-1447-4d64-afc4-9ba889a5f7dd-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq\" (UID: \"589a69de-1447-4d64-afc4-9ba889a5f7dd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq" Jul 08 18:09:14.668883 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.668857 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/589a69de-1447-4d64-afc4-9ba889a5f7dd-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq\" (UID: \"589a69de-1447-4d64-afc4-9ba889a5f7dd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq" Jul 08 18:09:14.680158 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.680135 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pszmd\" (UniqueName: \"kubernetes.io/projected/589a69de-1447-4d64-afc4-9ba889a5f7dd-kube-api-access-pszmd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq\" (UID: \"589a69de-1447-4d64-afc4-9ba889a5f7dd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq" Jul 08 18:09:14.754762 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.754707 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5f5rf"] Jul 08 18:09:14.757014 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.757001 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5f5rf" Jul 08 18:09:14.759817 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.759800 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-dkplh\"" Jul 08 18:09:14.759923 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.759905 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 08 18:09:14.760186 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.760171 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 08 18:09:14.772114 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.772093 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5f5rf"] Jul 08 18:09:14.814674 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.814647 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq" Jul 08 18:09:14.869908 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.869873 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gw2j\" (UniqueName: \"kubernetes.io/projected/480013da-52e3-4e90-a9d2-afbe77927c6c-kube-api-access-9gw2j\") pod \"cert-manager-webhook-6486ffd997-5f5rf\" (UID: \"480013da-52e3-4e90-a9d2-afbe77927c6c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5f5rf" Jul 08 18:09:14.870110 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.869925 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/480013da-52e3-4e90-a9d2-afbe77927c6c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5f5rf\" (UID: \"480013da-52e3-4e90-a9d2-afbe77927c6c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5f5rf" Jul 08 18:09:14.944674 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.944651 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq"] Jul 08 18:09:14.946700 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:09:14.946670 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod589a69de_1447_4d64_afc4_9ba889a5f7dd.slice/crio-2e340ac225065a8c7e7985b6f18dedbf5356ee3d9f9bc9baa2e2aef7a1321e5a WatchSource:0}: Error finding container 2e340ac225065a8c7e7985b6f18dedbf5356ee3d9f9bc9baa2e2aef7a1321e5a: Status 404 returned error can't find the container with id 2e340ac225065a8c7e7985b6f18dedbf5356ee3d9f9bc9baa2e2aef7a1321e5a Jul 08 18:09:14.970972 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.970946 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gw2j\" (UniqueName: \"kubernetes.io/projected/480013da-52e3-4e90-a9d2-afbe77927c6c-kube-api-access-9gw2j\") pod \"cert-manager-webhook-6486ffd997-5f5rf\" (UID: \"480013da-52e3-4e90-a9d2-afbe77927c6c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5f5rf" Jul 08 18:09:14.971120 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.970985 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/480013da-52e3-4e90-a9d2-afbe77927c6c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5f5rf\" (UID: \"480013da-52e3-4e90-a9d2-afbe77927c6c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5f5rf" Jul 08 18:09:14.992758 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.992685 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/480013da-52e3-4e90-a9d2-afbe77927c6c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5f5rf\" (UID: \"480013da-52e3-4e90-a9d2-afbe77927c6c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5f5rf" Jul 08 18:09:14.995222 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:14.995203 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gw2j\" (UniqueName: \"kubernetes.io/projected/480013da-52e3-4e90-a9d2-afbe77927c6c-kube-api-access-9gw2j\") pod \"cert-manager-webhook-6486ffd997-5f5rf\" (UID: \"480013da-52e3-4e90-a9d2-afbe77927c6c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5f5rf" Jul 08 18:09:15.075234 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:15.075210 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5f5rf" Jul 08 18:09:15.202738 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:15.202710 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5f5rf"] Jul 08 18:09:15.205122 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:09:15.205094 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod480013da_52e3_4e90_a9d2_afbe77927c6c.slice/crio-f697e86e5b5a428440eb297fe1165ce6f5069f456a9590ab5e45947e5409a9f3 WatchSource:0}: Error finding container f697e86e5b5a428440eb297fe1165ce6f5069f456a9590ab5e45947e5409a9f3: Status 404 returned error can't find the container with id f697e86e5b5a428440eb297fe1165ce6f5069f456a9590ab5e45947e5409a9f3 Jul 08 18:09:15.433824 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:15.433793 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5f5rf" event={"ID":"480013da-52e3-4e90-a9d2-afbe77927c6c","Type":"ContainerStarted","Data":"f697e86e5b5a428440eb297fe1165ce6f5069f456a9590ab5e45947e5409a9f3"} Jul 08 18:09:15.435201 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:15.435178 2574 generic.go:356] "Generic (PLEG): container finished" podID="589a69de-1447-4d64-afc4-9ba889a5f7dd" containerID="052c70fb523b16d16219d7c19f89ba56ecd3fe5bc1a7992c0f51313c52513726" exitCode=0 Jul 08 18:09:15.435289 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:15.435261 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq" event={"ID":"589a69de-1447-4d64-afc4-9ba889a5f7dd","Type":"ContainerDied","Data":"052c70fb523b16d16219d7c19f89ba56ecd3fe5bc1a7992c0f51313c52513726"} Jul 08 18:09:15.435353 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:15.435304 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq" event={"ID":"589a69de-1447-4d64-afc4-9ba889a5f7dd","Type":"ContainerStarted","Data":"2e340ac225065a8c7e7985b6f18dedbf5356ee3d9f9bc9baa2e2aef7a1321e5a"} Jul 08 18:09:19.455486 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:19.455450 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5f5rf" event={"ID":"480013da-52e3-4e90-a9d2-afbe77927c6c","Type":"ContainerStarted","Data":"c09681c37c0adad30b62e9f42b4749d83cf3d8780a03f4018ecc5fa7004935ea"} Jul 08 18:09:19.455856 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:19.455501 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5f5rf" Jul 08 18:09:19.457262 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:19.457238 2574 generic.go:356] "Generic (PLEG): container finished" podID="589a69de-1447-4d64-afc4-9ba889a5f7dd" containerID="690518772e57c849be51ce61fcb599fee5d25ad073501e756f9f003313b77700" exitCode=0 Jul 08 18:09:19.457345 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:19.457321 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq" event={"ID":"589a69de-1447-4d64-afc4-9ba889a5f7dd","Type":"ContainerDied","Data":"690518772e57c849be51ce61fcb599fee5d25ad073501e756f9f003313b77700"} Jul 08 18:09:19.495228 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:19.495162 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-5f5rf" podStartSLOduration=2.203441112 podStartE2EDuration="5.495142019s" totalImagesPullingTime="3.291700907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:09:19.494751951 +0000 UTC m=+293.738650117" watchObservedRunningTime="2026-07-08 18:09:19.495142019 +0000 UTC m=+293.739040188" Jul 08 18:09:20.462916 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:20.462883 2574 generic.go:356] "Generic (PLEG): container finished" podID="589a69de-1447-4d64-afc4-9ba889a5f7dd" containerID="94fbb8a7f9e9e550f120f9ca2a6f87ed9c7715c172e6947bcb23111eeb75d8d1" exitCode=0 Jul 08 18:09:20.463260 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:20.462948 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq" event={"ID":"589a69de-1447-4d64-afc4-9ba889a5f7dd","Type":"ContainerDied","Data":"94fbb8a7f9e9e550f120f9ca2a6f87ed9c7715c172e6947bcb23111eeb75d8d1"} Jul 08 18:09:21.592442 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:21.592418 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq" Jul 08 18:09:21.724015 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:21.723949 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pszmd\" (UniqueName: \"kubernetes.io/projected/589a69de-1447-4d64-afc4-9ba889a5f7dd-kube-api-access-pszmd\") pod \"589a69de-1447-4d64-afc4-9ba889a5f7dd\" (UID: \"589a69de-1447-4d64-afc4-9ba889a5f7dd\") " Jul 08 18:09:21.724175 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:21.724015 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/589a69de-1447-4d64-afc4-9ba889a5f7dd-util\") pod \"589a69de-1447-4d64-afc4-9ba889a5f7dd\" (UID: \"589a69de-1447-4d64-afc4-9ba889a5f7dd\") " Jul 08 18:09:21.724245 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:21.724219 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/589a69de-1447-4d64-afc4-9ba889a5f7dd-bundle\") pod \"589a69de-1447-4d64-afc4-9ba889a5f7dd\" (UID: \"589a69de-1447-4d64-afc4-9ba889a5f7dd\") " Jul 08 18:09:21.724566 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:21.724540 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/589a69de-1447-4d64-afc4-9ba889a5f7dd-bundle" (OuterVolumeSpecName: "bundle") pod "589a69de-1447-4d64-afc4-9ba889a5f7dd" (UID: "589a69de-1447-4d64-afc4-9ba889a5f7dd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:09:21.726144 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:21.726121 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/589a69de-1447-4d64-afc4-9ba889a5f7dd-kube-api-access-pszmd" (OuterVolumeSpecName: "kube-api-access-pszmd") pod "589a69de-1447-4d64-afc4-9ba889a5f7dd" (UID: "589a69de-1447-4d64-afc4-9ba889a5f7dd"). InnerVolumeSpecName "kube-api-access-pszmd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:09:21.729237 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:21.729203 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/589a69de-1447-4d64-afc4-9ba889a5f7dd-util" (OuterVolumeSpecName: "util") pod "589a69de-1447-4d64-afc4-9ba889a5f7dd" (UID: "589a69de-1447-4d64-afc4-9ba889a5f7dd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:09:21.825118 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:21.825092 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/589a69de-1447-4d64-afc4-9ba889a5f7dd-util\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:09:21.825118 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:21.825114 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/589a69de-1447-4d64-afc4-9ba889a5f7dd-bundle\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:09:21.825240 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:21.825126 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pszmd\" (UniqueName: \"kubernetes.io/projected/589a69de-1447-4d64-afc4-9ba889a5f7dd-kube-api-access-pszmd\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:09:22.473971 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.473934 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq" event={"ID":"589a69de-1447-4d64-afc4-9ba889a5f7dd","Type":"ContainerDied","Data":"2e340ac225065a8c7e7985b6f18dedbf5356ee3d9f9bc9baa2e2aef7a1321e5a"} Jul 08 18:09:22.474103 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.473992 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e340ac225065a8c7e7985b6f18dedbf5356ee3d9f9bc9baa2e2aef7a1321e5a" Jul 08 18:09:22.474103 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.473955 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqbxq" Jul 08 18:09:22.482581 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.482560 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hv7cq"] Jul 08 18:09:22.482833 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.482821 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="589a69de-1447-4d64-afc4-9ba889a5f7dd" containerName="util" Jul 08 18:09:22.482886 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.482835 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="589a69de-1447-4d64-afc4-9ba889a5f7dd" containerName="util" Jul 08 18:09:22.482886 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.482848 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="589a69de-1447-4d64-afc4-9ba889a5f7dd" containerName="pull" Jul 08 18:09:22.482886 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.482853 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="589a69de-1447-4d64-afc4-9ba889a5f7dd" containerName="pull" Jul 08 18:09:22.482886 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.482861 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="589a69de-1447-4d64-afc4-9ba889a5f7dd" containerName="extract" Jul 08 18:09:22.482886 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.482867 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="589a69de-1447-4d64-afc4-9ba889a5f7dd" containerName="extract" Jul 08 18:09:22.483066 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.482914 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="589a69de-1447-4d64-afc4-9ba889a5f7dd" containerName="extract" Jul 08 18:09:22.485983 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.485966 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hv7cq" Jul 08 18:09:22.488652 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.488635 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-z7hc8\"" Jul 08 18:09:22.497269 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.497243 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hv7cq"] Jul 08 18:09:22.630769 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.630705 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdzsg\" (UniqueName: \"kubernetes.io/projected/a2ab399d-ef76-4e49-ba93-2487e89e73e3-kube-api-access-wdzsg\") pod \"cert-manager-cainjector-559cdd8c87-hv7cq\" (UID: \"a2ab399d-ef76-4e49-ba93-2487e89e73e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hv7cq" Jul 08 18:09:22.631178 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.630797 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a2ab399d-ef76-4e49-ba93-2487e89e73e3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hv7cq\" (UID: \"a2ab399d-ef76-4e49-ba93-2487e89e73e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hv7cq" Jul 08 18:09:22.731638 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.731609 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdzsg\" (UniqueName: \"kubernetes.io/projected/a2ab399d-ef76-4e49-ba93-2487e89e73e3-kube-api-access-wdzsg\") pod \"cert-manager-cainjector-559cdd8c87-hv7cq\" (UID: \"a2ab399d-ef76-4e49-ba93-2487e89e73e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hv7cq" Jul 08 18:09:22.731746 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.731663 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a2ab399d-ef76-4e49-ba93-2487e89e73e3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hv7cq\" (UID: \"a2ab399d-ef76-4e49-ba93-2487e89e73e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hv7cq" Jul 08 18:09:22.741829 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.741805 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdzsg\" (UniqueName: \"kubernetes.io/projected/a2ab399d-ef76-4e49-ba93-2487e89e73e3-kube-api-access-wdzsg\") pod \"cert-manager-cainjector-559cdd8c87-hv7cq\" (UID: \"a2ab399d-ef76-4e49-ba93-2487e89e73e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hv7cq" Jul 08 18:09:22.745266 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.745245 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a2ab399d-ef76-4e49-ba93-2487e89e73e3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hv7cq\" (UID: \"a2ab399d-ef76-4e49-ba93-2487e89e73e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hv7cq" Jul 08 18:09:22.794233 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.794211 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hv7cq" Jul 08 18:09:22.924740 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:22.924697 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hv7cq"] Jul 08 18:09:22.926715 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:09:22.926691 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2ab399d_ef76_4e49_ba93_2487e89e73e3.slice/crio-070be67d3b9f9810672957c4d9d10f74f8eefd5b11e8f0d90f06efb062ffbbb3 WatchSource:0}: Error finding container 070be67d3b9f9810672957c4d9d10f74f8eefd5b11e8f0d90f06efb062ffbbb3: Status 404 returned error can't find the container with id 070be67d3b9f9810672957c4d9d10f74f8eefd5b11e8f0d90f06efb062ffbbb3 Jul 08 18:09:23.480433 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:23.480387 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hv7cq" event={"ID":"a2ab399d-ef76-4e49-ba93-2487e89e73e3","Type":"ContainerStarted","Data":"a8d11aea93ecd2c192e4ddad0a103b0d56a4ac89f58a9c4ec10e7ccae699e5a6"} Jul 08 18:09:23.480433 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:23.480435 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hv7cq" event={"ID":"a2ab399d-ef76-4e49-ba93-2487e89e73e3","Type":"ContainerStarted","Data":"070be67d3b9f9810672957c4d9d10f74f8eefd5b11e8f0d90f06efb062ffbbb3"} Jul 08 18:09:23.510493 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:23.510447 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hv7cq" podStartSLOduration=1.510430985 podStartE2EDuration="1.510430985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:09:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:09:23.509450494 +0000 UTC m=+297.753348682" watchObservedRunningTime="2026-07-08 18:09:23.510430985 +0000 UTC m=+297.754329153" Jul 08 18:09:25.465278 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:25.465253 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5f5rf" Jul 08 18:09:26.150086 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:26.150058 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9ftw_6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe/ovn-acl-logging/0.log" Jul 08 18:09:26.150929 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:26.150907 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9ftw_6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe/ovn-acl-logging/0.log" Jul 08 18:09:26.159397 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:26.159380 2574 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 18:09:28.989043 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:28.988986 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nb695"] Jul 08 18:09:28.992266 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:28.992242 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nb695" Jul 08 18:09:28.995093 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:28.995070 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 18:09:28.996213 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:28.996196 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:09:28.996291 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:28.996237 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-kq8sm\"" Jul 08 18:09:29.004549 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:29.004530 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nb695"] Jul 08 18:09:29.093307 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:29.093281 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b894f765-1370-4037-afc8-321712e9eb40-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nb695\" (UID: \"b894f765-1370-4037-afc8-321712e9eb40\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nb695" Jul 08 18:09:29.093405 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:29.093318 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dbp2\" (UniqueName: \"kubernetes.io/projected/b894f765-1370-4037-afc8-321712e9eb40-kube-api-access-8dbp2\") pod \"openshift-lws-operator-fd8ccff4c-nb695\" (UID: \"b894f765-1370-4037-afc8-321712e9eb40\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nb695" Jul 08 18:09:29.194266 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:29.194239 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dbp2\" (UniqueName: \"kubernetes.io/projected/b894f765-1370-4037-afc8-321712e9eb40-kube-api-access-8dbp2\") pod \"openshift-lws-operator-fd8ccff4c-nb695\" (UID: \"b894f765-1370-4037-afc8-321712e9eb40\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nb695" Jul 08 18:09:29.194371 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:29.194311 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b894f765-1370-4037-afc8-321712e9eb40-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nb695\" (UID: \"b894f765-1370-4037-afc8-321712e9eb40\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nb695" Jul 08 18:09:29.194662 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:29.194641 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b894f765-1370-4037-afc8-321712e9eb40-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nb695\" (UID: \"b894f765-1370-4037-afc8-321712e9eb40\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nb695" Jul 08 18:09:29.206045 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:29.206000 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dbp2\" (UniqueName: \"kubernetes.io/projected/b894f765-1370-4037-afc8-321712e9eb40-kube-api-access-8dbp2\") pod \"openshift-lws-operator-fd8ccff4c-nb695\" (UID: \"b894f765-1370-4037-afc8-321712e9eb40\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nb695" Jul 08 18:09:29.302302 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:29.302242 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nb695" Jul 08 18:09:29.441919 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:29.441816 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nb695"] Jul 08 18:09:29.444185 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:09:29.444161 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb894f765_1370_4037_afc8_321712e9eb40.slice/crio-2b050d16667d076f3a9b20e732546327827049e161ee7a4ee4718a97c91aab03 WatchSource:0}: Error finding container 2b050d16667d076f3a9b20e732546327827049e161ee7a4ee4718a97c91aab03: Status 404 returned error can't find the container with id 2b050d16667d076f3a9b20e732546327827049e161ee7a4ee4718a97c91aab03 Jul 08 18:09:29.445754 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:29.445737 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:09:29.505936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:29.505908 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nb695" event={"ID":"b894f765-1370-4037-afc8-321712e9eb40","Type":"ContainerStarted","Data":"2b050d16667d076f3a9b20e732546327827049e161ee7a4ee4718a97c91aab03"} Jul 08 18:09:32.520529 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:32.520449 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nb695" event={"ID":"b894f765-1370-4037-afc8-321712e9eb40","Type":"ContainerStarted","Data":"01abba0d07b460cc439008f5eb8d075fcf54d62892effa42516bd6ee2fb9f24c"} Jul 08 18:09:32.542451 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:32.542407 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nb695" podStartSLOduration=1.783636783 podStartE2EDuration="4.542392s" totalImagesPullingTime="2.758755217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:09:32.540438181 +0000 UTC m=+306.784336350" watchObservedRunningTime="2026-07-08 18:09:32.542392 +0000 UTC m=+306.786290164" Jul 08 18:09:35.078226 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:35.078189 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p"] Jul 08 18:09:35.080862 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:35.080845 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p" Jul 08 18:09:35.083714 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:35.083690 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pqj58\"" Jul 08 18:09:35.083714 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:35.083707 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 18:09:35.084992 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:35.084947 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 18:09:35.091217 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:35.091191 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p"] Jul 08 18:09:35.239386 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:35.239360 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b3bf96d-b151-4d10-9a2f-543bc883125d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p\" (UID: \"0b3bf96d-b151-4d10-9a2f-543bc883125d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p" Jul 08 18:09:35.239497 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:35.239396 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c58kk\" (UniqueName: \"kubernetes.io/projected/0b3bf96d-b151-4d10-9a2f-543bc883125d-kube-api-access-c58kk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p\" (UID: \"0b3bf96d-b151-4d10-9a2f-543bc883125d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p" Jul 08 18:09:35.239539 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:35.239495 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b3bf96d-b151-4d10-9a2f-543bc883125d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p\" (UID: \"0b3bf96d-b151-4d10-9a2f-543bc883125d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p" Jul 08 18:09:35.340720 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:35.340658 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b3bf96d-b151-4d10-9a2f-543bc883125d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p\" (UID: \"0b3bf96d-b151-4d10-9a2f-543bc883125d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p" Jul 08 18:09:35.340720 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:35.340689 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b3bf96d-b151-4d10-9a2f-543bc883125d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p\" (UID: \"0b3bf96d-b151-4d10-9a2f-543bc883125d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p" Jul 08 18:09:35.340720 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:35.340718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c58kk\" (UniqueName: \"kubernetes.io/projected/0b3bf96d-b151-4d10-9a2f-543bc883125d-kube-api-access-c58kk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p\" (UID: \"0b3bf96d-b151-4d10-9a2f-543bc883125d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p" Jul 08 18:09:35.341069 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:35.341016 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b3bf96d-b151-4d10-9a2f-543bc883125d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p\" (UID: \"0b3bf96d-b151-4d10-9a2f-543bc883125d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p" Jul 08 18:09:35.341137 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:35.341121 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b3bf96d-b151-4d10-9a2f-543bc883125d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p\" (UID: \"0b3bf96d-b151-4d10-9a2f-543bc883125d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p" Jul 08 18:09:35.356516 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:35.356485 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c58kk\" (UniqueName: \"kubernetes.io/projected/0b3bf96d-b151-4d10-9a2f-543bc883125d-kube-api-access-c58kk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p\" (UID: \"0b3bf96d-b151-4d10-9a2f-543bc883125d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p" Jul 08 18:09:35.390456 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:35.390426 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p" Jul 08 18:09:35.520392 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:35.520322 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p"] Jul 08 18:09:35.522529 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:09:35.522501 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3bf96d_b151_4d10_9a2f_543bc883125d.slice/crio-139a3ac93686787b54a1d4a913ffa06c0f31d9df459c426ed2d5cf3ec8f02d03 WatchSource:0}: Error finding container 139a3ac93686787b54a1d4a913ffa06c0f31d9df459c426ed2d5cf3ec8f02d03: Status 404 returned error can't find the container with id 139a3ac93686787b54a1d4a913ffa06c0f31d9df459c426ed2d5cf3ec8f02d03 Jul 08 18:09:35.536087 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:35.536058 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p" event={"ID":"0b3bf96d-b151-4d10-9a2f-543bc883125d","Type":"ContainerStarted","Data":"139a3ac93686787b54a1d4a913ffa06c0f31d9df459c426ed2d5cf3ec8f02d03"} Jul 08 18:09:36.542095 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:36.542062 2574 generic.go:356] "Generic (PLEG): container finished" podID="0b3bf96d-b151-4d10-9a2f-543bc883125d" containerID="84e985dfce0e4695d33ccd29da4069c4751b2ad898e466beb70e08758d43c3bb" exitCode=0 Jul 08 18:09:36.542436 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:36.542180 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p" event={"ID":"0b3bf96d-b151-4d10-9a2f-543bc883125d","Type":"ContainerDied","Data":"84e985dfce0e4695d33ccd29da4069c4751b2ad898e466beb70e08758d43c3bb"} Jul 08 18:09:37.548830 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:37.548795 2574 generic.go:356] "Generic (PLEG): container finished" podID="0b3bf96d-b151-4d10-9a2f-543bc883125d" containerID="cd0d3aa8548fa53a0d8cd80afbacafd6512873bce818747f2bbc12deee627864" exitCode=0 Jul 08 18:09:37.549188 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:37.548886 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p" event={"ID":"0b3bf96d-b151-4d10-9a2f-543bc883125d","Type":"ContainerDied","Data":"cd0d3aa8548fa53a0d8cd80afbacafd6512873bce818747f2bbc12deee627864"} Jul 08 18:09:38.555259 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:38.555225 2574 generic.go:356] "Generic (PLEG): container finished" podID="0b3bf96d-b151-4d10-9a2f-543bc883125d" containerID="f5d128015fbcef75beceeae6605eb18bdacf9c6fb5c9570c2d5f85ef9e76d34f" exitCode=0 Jul 08 18:09:38.555683 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:38.555290 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p" event={"ID":"0b3bf96d-b151-4d10-9a2f-543bc883125d","Type":"ContainerDied","Data":"f5d128015fbcef75beceeae6605eb18bdacf9c6fb5c9570c2d5f85ef9e76d34f"} Jul 08 18:09:39.686505 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:39.686482 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p" Jul 08 18:09:39.877241 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:39.877183 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b3bf96d-b151-4d10-9a2f-543bc883125d-util\") pod \"0b3bf96d-b151-4d10-9a2f-543bc883125d\" (UID: \"0b3bf96d-b151-4d10-9a2f-543bc883125d\") " Jul 08 18:09:39.877241 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:39.877210 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b3bf96d-b151-4d10-9a2f-543bc883125d-bundle\") pod \"0b3bf96d-b151-4d10-9a2f-543bc883125d\" (UID: \"0b3bf96d-b151-4d10-9a2f-543bc883125d\") " Jul 08 18:09:39.877440 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:39.877257 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c58kk\" (UniqueName: \"kubernetes.io/projected/0b3bf96d-b151-4d10-9a2f-543bc883125d-kube-api-access-c58kk\") pod \"0b3bf96d-b151-4d10-9a2f-543bc883125d\" (UID: \"0b3bf96d-b151-4d10-9a2f-543bc883125d\") " Jul 08 18:09:39.877893 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:39.877869 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b3bf96d-b151-4d10-9a2f-543bc883125d-bundle" (OuterVolumeSpecName: "bundle") pod "0b3bf96d-b151-4d10-9a2f-543bc883125d" (UID: "0b3bf96d-b151-4d10-9a2f-543bc883125d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:09:39.879495 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:39.879471 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b3bf96d-b151-4d10-9a2f-543bc883125d-kube-api-access-c58kk" (OuterVolumeSpecName: "kube-api-access-c58kk") pod "0b3bf96d-b151-4d10-9a2f-543bc883125d" (UID: "0b3bf96d-b151-4d10-9a2f-543bc883125d"). InnerVolumeSpecName "kube-api-access-c58kk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:09:39.883320 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:39.883295 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b3bf96d-b151-4d10-9a2f-543bc883125d-util" (OuterVolumeSpecName: "util") pod "0b3bf96d-b151-4d10-9a2f-543bc883125d" (UID: "0b3bf96d-b151-4d10-9a2f-543bc883125d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:09:39.977955 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:39.977932 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b3bf96d-b151-4d10-9a2f-543bc883125d-util\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:09:39.977955 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:39.977954 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b3bf96d-b151-4d10-9a2f-543bc883125d-bundle\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:09:39.978102 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:39.977963 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c58kk\" (UniqueName: \"kubernetes.io/projected/0b3bf96d-b151-4d10-9a2f-543bc883125d-kube-api-access-c58kk\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:09:40.566424 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:40.566334 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p" event={"ID":"0b3bf96d-b151-4d10-9a2f-543bc883125d","Type":"ContainerDied","Data":"139a3ac93686787b54a1d4a913ffa06c0f31d9df459c426ed2d5cf3ec8f02d03"} Jul 08 18:09:40.566424 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:40.566390 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="139a3ac93686787b54a1d4a913ffa06c0f31d9df459c426ed2d5cf3ec8f02d03" Jul 08 18:09:40.566424 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:40.566387 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5286p" Jul 08 18:09:52.301333 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.301303 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb"] Jul 08 18:09:52.301709 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.301573 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b3bf96d-b151-4d10-9a2f-543bc883125d" containerName="pull" Jul 08 18:09:52.301709 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.301586 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b3bf96d-b151-4d10-9a2f-543bc883125d" containerName="pull" Jul 08 18:09:52.301709 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.301596 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b3bf96d-b151-4d10-9a2f-543bc883125d" containerName="util" Jul 08 18:09:52.301709 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.301602 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b3bf96d-b151-4d10-9a2f-543bc883125d" containerName="util" Jul 08 18:09:52.301709 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.301611 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b3bf96d-b151-4d10-9a2f-543bc883125d" containerName="extract" Jul 08 18:09:52.301709 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.301616 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b3bf96d-b151-4d10-9a2f-543bc883125d" containerName="extract" Jul 08 18:09:52.301709 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.301670 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b3bf96d-b151-4d10-9a2f-543bc883125d" containerName="extract" Jul 08 18:09:52.305339 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.305322 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" Jul 08 18:09:52.310490 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.310464 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 18:09:52.310686 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.310668 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 18:09:52.310782 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.310684 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 18:09:52.310782 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.310676 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pxw5w\"" Jul 08 18:09:52.311126 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.311106 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 18:09:52.336969 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.336945 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb"] Jul 08 18:09:52.360740 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.360708 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh7gm\" (UniqueName: \"kubernetes.io/projected/54ff0713-3d3c-4667-84cb-2585177bed45-kube-api-access-kh7gm\") pod \"opendatahub-operator-controller-manager-859965ff4-kxwvb\" (UID: \"54ff0713-3d3c-4667-84cb-2585177bed45\") " pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" Jul 08 18:09:52.360868 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.360778 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54ff0713-3d3c-4667-84cb-2585177bed45-tmp\") pod \"opendatahub-operator-controller-manager-859965ff4-kxwvb\" (UID: \"54ff0713-3d3c-4667-84cb-2585177bed45\") " pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" Jul 08 18:09:52.360868 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.360810 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/54ff0713-3d3c-4667-84cb-2585177bed45-manifests\") pod \"opendatahub-operator-controller-manager-859965ff4-kxwvb\" (UID: \"54ff0713-3d3c-4667-84cb-2585177bed45\") " pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" Jul 08 18:09:52.360868 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.360852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/54ff0713-3d3c-4667-84cb-2585177bed45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-859965ff4-kxwvb\" (UID: \"54ff0713-3d3c-4667-84cb-2585177bed45\") " pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" Jul 08 18:09:52.361042 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.360880 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/54ff0713-3d3c-4667-84cb-2585177bed45-webhook-cert\") pod \"opendatahub-operator-controller-manager-859965ff4-kxwvb\" (UID: \"54ff0713-3d3c-4667-84cb-2585177bed45\") " pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" Jul 08 18:09:52.409684 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.409619 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg"] Jul 08 18:09:52.411913 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.411888 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg" Jul 08 18:09:52.416640 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.416620 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-f5v9n\"" Jul 08 18:09:52.416757 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.416689 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 08 18:09:52.417272 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.417252 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 08 18:09:52.417484 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.417465 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 08 18:09:52.435884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.435862 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg"] Jul 08 18:09:52.461203 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.461184 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6665a10-a660-4259-9e6c-504b1e9a9a76-cert\") pod \"lws-controller-manager-68bbd4cf59-x6dqg\" (UID: \"d6665a10-a660-4259-9e6c-504b1e9a9a76\") " pod="openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg" Jul 08 18:09:52.461300 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.461220 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54ff0713-3d3c-4667-84cb-2585177bed45-tmp\") pod \"opendatahub-operator-controller-manager-859965ff4-kxwvb\" (UID: \"54ff0713-3d3c-4667-84cb-2585177bed45\") " pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" Jul 08 18:09:52.461300 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.461243 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/54ff0713-3d3c-4667-84cb-2585177bed45-manifests\") pod \"opendatahub-operator-controller-manager-859965ff4-kxwvb\" (UID: \"54ff0713-3d3c-4667-84cb-2585177bed45\") " pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" Jul 08 18:09:52.461300 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.461269 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6665a10-a660-4259-9e6c-504b1e9a9a76-metrics-cert\") pod \"lws-controller-manager-68bbd4cf59-x6dqg\" (UID: \"d6665a10-a660-4259-9e6c-504b1e9a9a76\") " pod="openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg" Jul 08 18:09:52.461300 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.461297 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpwl2\" (UniqueName: \"kubernetes.io/projected/d6665a10-a660-4259-9e6c-504b1e9a9a76-kube-api-access-hpwl2\") pod \"lws-controller-manager-68bbd4cf59-x6dqg\" (UID: \"d6665a10-a660-4259-9e6c-504b1e9a9a76\") " pod="openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg" Jul 08 18:09:52.461511 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.461323 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/54ff0713-3d3c-4667-84cb-2585177bed45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-859965ff4-kxwvb\" (UID: \"54ff0713-3d3c-4667-84cb-2585177bed45\") " pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" Jul 08 18:09:52.461511 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.461386 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/54ff0713-3d3c-4667-84cb-2585177bed45-webhook-cert\") pod \"opendatahub-operator-controller-manager-859965ff4-kxwvb\" (UID: \"54ff0713-3d3c-4667-84cb-2585177bed45\") " pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" Jul 08 18:09:52.461511 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.461431 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh7gm\" (UniqueName: \"kubernetes.io/projected/54ff0713-3d3c-4667-84cb-2585177bed45-kube-api-access-kh7gm\") pod \"opendatahub-operator-controller-manager-859965ff4-kxwvb\" (UID: \"54ff0713-3d3c-4667-84cb-2585177bed45\") " pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" Jul 08 18:09:52.461511 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.461488 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d6665a10-a660-4259-9e6c-504b1e9a9a76-manager-config\") pod \"lws-controller-manager-68bbd4cf59-x6dqg\" (UID: \"d6665a10-a660-4259-9e6c-504b1e9a9a76\") " pod="openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg" Jul 08 18:09:52.461717 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.461695 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/54ff0713-3d3c-4667-84cb-2585177bed45-manifests\") pod \"opendatahub-operator-controller-manager-859965ff4-kxwvb\" (UID: \"54ff0713-3d3c-4667-84cb-2585177bed45\") " pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" Jul 08 18:09:52.464053 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.464002 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/54ff0713-3d3c-4667-84cb-2585177bed45-webhook-cert\") pod \"opendatahub-operator-controller-manager-859965ff4-kxwvb\" (UID: \"54ff0713-3d3c-4667-84cb-2585177bed45\") " pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" Jul 08 18:09:52.464145 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.464105 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/54ff0713-3d3c-4667-84cb-2585177bed45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-859965ff4-kxwvb\" (UID: \"54ff0713-3d3c-4667-84cb-2585177bed45\") " pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" Jul 08 18:09:52.464192 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.464148 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54ff0713-3d3c-4667-84cb-2585177bed45-tmp\") pod \"opendatahub-operator-controller-manager-859965ff4-kxwvb\" (UID: \"54ff0713-3d3c-4667-84cb-2585177bed45\") " pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" Jul 08 18:09:52.475205 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.475186 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh7gm\" (UniqueName: \"kubernetes.io/projected/54ff0713-3d3c-4667-84cb-2585177bed45-kube-api-access-kh7gm\") pod \"opendatahub-operator-controller-manager-859965ff4-kxwvb\" (UID: \"54ff0713-3d3c-4667-84cb-2585177bed45\") " pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" Jul 08 18:09:52.562343 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.562288 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d6665a10-a660-4259-9e6c-504b1e9a9a76-manager-config\") pod \"lws-controller-manager-68bbd4cf59-x6dqg\" (UID: \"d6665a10-a660-4259-9e6c-504b1e9a9a76\") " pod="openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg" Jul 08 18:09:52.562343 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.562328 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6665a10-a660-4259-9e6c-504b1e9a9a76-cert\") pod \"lws-controller-manager-68bbd4cf59-x6dqg\" (UID: \"d6665a10-a660-4259-9e6c-504b1e9a9a76\") " pod="openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg" Jul 08 18:09:52.562502 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.562359 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6665a10-a660-4259-9e6c-504b1e9a9a76-metrics-cert\") pod \"lws-controller-manager-68bbd4cf59-x6dqg\" (UID: \"d6665a10-a660-4259-9e6c-504b1e9a9a76\") " pod="openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg" Jul 08 18:09:52.562502 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.562378 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpwl2\" (UniqueName: \"kubernetes.io/projected/d6665a10-a660-4259-9e6c-504b1e9a9a76-kube-api-access-hpwl2\") pod \"lws-controller-manager-68bbd4cf59-x6dqg\" (UID: \"d6665a10-a660-4259-9e6c-504b1e9a9a76\") " pod="openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg" Jul 08 18:09:52.562927 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.562905 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d6665a10-a660-4259-9e6c-504b1e9a9a76-manager-config\") pod \"lws-controller-manager-68bbd4cf59-x6dqg\" (UID: \"d6665a10-a660-4259-9e6c-504b1e9a9a76\") " pod="openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg" Jul 08 18:09:52.564736 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.564719 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6665a10-a660-4259-9e6c-504b1e9a9a76-cert\") pod \"lws-controller-manager-68bbd4cf59-x6dqg\" (UID: \"d6665a10-a660-4259-9e6c-504b1e9a9a76\") " pod="openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg" Jul 08 18:09:52.564793 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.564735 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6665a10-a660-4259-9e6c-504b1e9a9a76-metrics-cert\") pod \"lws-controller-manager-68bbd4cf59-x6dqg\" (UID: \"d6665a10-a660-4259-9e6c-504b1e9a9a76\") " pod="openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg" Jul 08 18:09:52.605615 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.605587 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpwl2\" (UniqueName: \"kubernetes.io/projected/d6665a10-a660-4259-9e6c-504b1e9a9a76-kube-api-access-hpwl2\") pod \"lws-controller-manager-68bbd4cf59-x6dqg\" (UID: \"d6665a10-a660-4259-9e6c-504b1e9a9a76\") " pod="openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg" Jul 08 18:09:52.615310 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.615289 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" Jul 08 18:09:52.723397 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.723373 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg" Jul 08 18:09:52.807180 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.807054 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb"] Jul 08 18:09:52.809218 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:09:52.809192 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ff0713_3d3c_4667_84cb_2585177bed45.slice/crio-5008297712edf3f54509dfc8f4937553cb49074004515f63acb61f5e4b2c8d01 WatchSource:0}: Error finding container 5008297712edf3f54509dfc8f4937553cb49074004515f63acb61f5e4b2c8d01: Status 404 returned error can't find the container with id 5008297712edf3f54509dfc8f4937553cb49074004515f63acb61f5e4b2c8d01 Jul 08 18:09:52.874561 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:52.874433 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg"] Jul 08 18:09:52.876448 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:09:52.876427 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6665a10_a660_4259_9e6c_504b1e9a9a76.slice/crio-0752a0bf8958cf8de54168d6cd938c5db159e54d5cf19d92c3d4a357f666c9b9 WatchSource:0}: Error finding container 0752a0bf8958cf8de54168d6cd938c5db159e54d5cf19d92c3d4a357f666c9b9: Status 404 returned error can't find the container with id 0752a0bf8958cf8de54168d6cd938c5db159e54d5cf19d92c3d4a357f666c9b9 Jul 08 18:09:53.624428 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:53.624394 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" event={"ID":"54ff0713-3d3c-4667-84cb-2585177bed45","Type":"ContainerStarted","Data":"5008297712edf3f54509dfc8f4937553cb49074004515f63acb61f5e4b2c8d01"} Jul 08 18:09:53.625575 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:53.625551 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg" event={"ID":"d6665a10-a660-4259-9e6c-504b1e9a9a76","Type":"ContainerStarted","Data":"0752a0bf8958cf8de54168d6cd938c5db159e54d5cf19d92c3d4a357f666c9b9"} Jul 08 18:09:57.647049 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:57.646986 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" event={"ID":"54ff0713-3d3c-4667-84cb-2585177bed45","Type":"ContainerStarted","Data":"f2d6ea0cd8b25cc8202eb9d48a8237a0c8ca0e67f6236817ece984a6e6207366"} Jul 08 18:09:57.648681 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:57.648650 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg" event={"ID":"d6665a10-a660-4259-9e6c-504b1e9a9a76","Type":"ContainerStarted","Data":"9ced27258df522b17cb0a11035d3aafd18bd3bc65189f6ef2d16b5a202bbac15"} Jul 08 18:09:57.648819 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:57.648717 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg" Jul 08 18:09:57.696837 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:57.696793 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg" podStartSLOduration=1.793594903 podStartE2EDuration="5.696777697s" totalImagesPullingTime="3.903182794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:09:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:09:57.695132872 +0000 UTC m=+331.939031067" watchObservedRunningTime="2026-07-08 18:09:57.696777697 +0000 UTC m=+331.940675861" Jul 08 18:09:58.655742 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:58.655699 2574 generic.go:356] "Generic (PLEG): container finished" podID="54ff0713-3d3c-4667-84cb-2585177bed45" containerID="f2d6ea0cd8b25cc8202eb9d48a8237a0c8ca0e67f6236817ece984a6e6207366" exitCode=0 Jul 08 18:09:58.656141 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:58.655806 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" event={"ID":"54ff0713-3d3c-4667-84cb-2585177bed45","Type":"ContainerDied","Data":"f2d6ea0cd8b25cc8202eb9d48a8237a0c8ca0e67f6236817ece984a6e6207366"} Jul 08 18:09:59.663554 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:59.663517 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" event={"ID":"54ff0713-3d3c-4667-84cb-2585177bed45","Type":"ContainerStarted","Data":"2dccb27daf45b5b8c5ebb5e3dd6ce894fbc53e46b8b4673bb0ab7eda6c23d9d3"} Jul 08 18:09:59.664009 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:59.663636 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" Jul 08 18:09:59.701190 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:09:59.696904 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" podStartSLOduration=2.300744179 podStartE2EDuration="7.696885724s" totalImagesPullingTime="4.369095751s" totalInitContainerRuntime="1.027045794s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:09:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:09:59.694294368 +0000 UTC m=+333.938192554" watchObservedRunningTime="2026-07-08 18:09:59.696885724 +0000 UTC m=+333.940783905" Jul 08 18:10:08.658156 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:08.658128 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68bbd4cf59-x6dqg" Jul 08 18:10:10.670039 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:10.669997 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-859965ff4-kxwvb" Jul 08 18:10:22.039967 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.039890 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl"] Jul 08 18:10:22.043329 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.043310 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.047688 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.047667 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 08 18:10:22.048054 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.048014 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 08 18:10:22.048149 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.048107 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gxcj2\"" Jul 08 18:10:22.054003 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.053985 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 18:10:22.054116 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.054045 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 08 18:10:22.054116 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.054081 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 18:10:22.054238 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.054113 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 18:10:22.067709 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.067687 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl"] Jul 08 18:10:22.091342 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.091310 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.091453 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.091362 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.091453 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.091435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.091546 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.091475 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.091546 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.091494 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.091546 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.091532 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw7kk\" (UniqueName: \"kubernetes.io/projected/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-kube-api-access-jw7kk\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.091640 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.091557 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.192703 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.192666 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.192875 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.192715 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.192875 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.192833 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.192991 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.192882 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw7kk\" (UniqueName: \"kubernetes.io/projected/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-kube-api-access-jw7kk\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.192991 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.192915 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.192991 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.192985 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.193224 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.193051 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.193587 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.193544 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.195377 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.195351 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.195468 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.195429 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.195655 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.195636 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.195766 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.195750 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.206268 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.206242 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.206581 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.206565 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw7kk\" (UniqueName: \"kubernetes.io/projected/fd5077e2-ecdb-40ee-a0e2-83138e2a7c86-kube-api-access-jw7kk\") pod \"istiod-openshift-gateway-94bb8fbfd-qvmcl\" (UID: \"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.352493 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.352415 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:22.519829 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.519796 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl"] Jul 08 18:10:22.523149 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:10:22.523118 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd5077e2_ecdb_40ee_a0e2_83138e2a7c86.slice/crio-a5312cf60e440b0ddde713233414604f5948ded4b3f17cae1b98c44fab475445 WatchSource:0}: Error finding container a5312cf60e440b0ddde713233414604f5948ded4b3f17cae1b98c44fab475445: Status 404 returned error can't find the container with id a5312cf60e440b0ddde713233414604f5948ded4b3f17cae1b98c44fab475445 Jul 08 18:10:22.768807 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:22.768769 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" event={"ID":"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86","Type":"ContainerStarted","Data":"a5312cf60e440b0ddde713233414604f5948ded4b3f17cae1b98c44fab475445"} Jul 08 18:10:25.471755 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:25.471708 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 18:10:25.472182 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:25.471799 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 18:10:25.782922 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:25.782838 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" event={"ID":"fd5077e2-ecdb-40ee-a0e2-83138e2a7c86","Type":"ContainerStarted","Data":"2f39523800302180cd7dda53bc0b3c4e80aecbe1ae20e78437cd204fae0c6a6b"} Jul 08 18:10:25.783092 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:25.782970 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:26.791252 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:26.791218 2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-qvmcl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 08 18:10:26.791620 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:26.791288 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" podUID="fd5077e2-ecdb-40ee-a0e2-83138e2a7c86" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 18:10:29.789796 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:29.789767 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" Jul 08 18:10:29.845533 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:29.845483 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qvmcl" podStartSLOduration=4.899353384 podStartE2EDuration="7.845466613s" totalImagesPullingTime="2.946113229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:10:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:10:26.176336414 +0000 UTC m=+360.420234579" watchObservedRunningTime="2026-07-08 18:10:29.845466613 +0000 UTC m=+364.089364780" Jul 08 18:10:54.943511 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:54.943446 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74fd9d7449-sprrk"] Jul 08 18:10:54.949829 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:54.949807 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:54.963768 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:54.963742 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74fd9d7449-sprrk"] Jul 08 18:10:54.981723 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:54.981702 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-trusted-ca-bundle\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:54.981811 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:54.981740 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-service-ca\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:54.981811 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:54.981759 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-console-config\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:54.981811 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:54.981780 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-oauth-serving-cert\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:54.981811 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:54.981804 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-console-serving-cert\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:54.981936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:54.981821 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf4j2\" (UniqueName: \"kubernetes.io/projected/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-kube-api-access-gf4j2\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:54.981936 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:54.981884 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-console-oauth-config\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:55.082905 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:55.082879 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-console-oauth-config\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:55.082994 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:55.082918 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-trusted-ca-bundle\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:55.082994 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:55.082963 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-service-ca\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:55.082994 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:55.082987 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-console-config\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:55.083154 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:55.083013 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-oauth-serving-cert\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:55.083154 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:55.083070 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-console-serving-cert\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:55.083239 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:55.083191 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf4j2\" (UniqueName: \"kubernetes.io/projected/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-kube-api-access-gf4j2\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:55.083823 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:55.083796 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-oauth-serving-cert\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:55.083823 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:55.083817 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-service-ca\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:55.083941 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:55.083879 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-trusted-ca-bundle\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:55.084103 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:55.084082 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-console-config\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:55.085628 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:55.085610 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-console-oauth-config\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:55.085737 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:55.085719 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-console-serving-cert\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:55.093346 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:55.093321 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf4j2\" (UniqueName: \"kubernetes.io/projected/747d5f57-5ab0-4ec0-b231-4db9c215fbfa-kube-api-access-gf4j2\") pod \"console-74fd9d7449-sprrk\" (UID: \"747d5f57-5ab0-4ec0-b231-4db9c215fbfa\") " pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:55.258712 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:55.258659 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:10:55.392645 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:55.392621 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74fd9d7449-sprrk"] Jul 08 18:10:55.394376 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:10:55.394352 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod747d5f57_5ab0_4ec0_b231_4db9c215fbfa.slice/crio-7dda3d813ab03d0aeba13935c802d2860600432a3a959ec0d1096c1318f4d4a2 WatchSource:0}: Error finding container 7dda3d813ab03d0aeba13935c802d2860600432a3a959ec0d1096c1318f4d4a2: Status 404 returned error can't find the container with id 7dda3d813ab03d0aeba13935c802d2860600432a3a959ec0d1096c1318f4d4a2 Jul 08 18:10:55.924856 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:55.924815 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74fd9d7449-sprrk" event={"ID":"747d5f57-5ab0-4ec0-b231-4db9c215fbfa","Type":"ContainerStarted","Data":"070be914c5c508663304ae46ea83ddf1f0040c5d877c16c76fb57ab4d43cbcab"} Jul 08 18:10:55.925081 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:55.924885 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74fd9d7449-sprrk" event={"ID":"747d5f57-5ab0-4ec0-b231-4db9c215fbfa","Type":"ContainerStarted","Data":"7dda3d813ab03d0aeba13935c802d2860600432a3a959ec0d1096c1318f4d4a2"} Jul 08 18:10:55.949182 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:10:55.949131 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74fd9d7449-sprrk" podStartSLOduration=1.949116218 podStartE2EDuration="1.949116218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:10:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:10:55.947227163 +0000 UTC m=+390.191125328" watchObservedRunningTime="2026-07-08 18:10:55.949116218 +0000 UTC m=+390.193014456" Jul 08 18:11:05.259610 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:05.259569 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:11:05.260112 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:05.259646 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:11:05.264526 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:05.264504 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:11:05.976901 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:05.976867 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74fd9d7449-sprrk" Jul 08 18:11:06.070909 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:06.070881 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fc95b67c8-ndrxb"] Jul 08 18:11:30.867639 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:30.867605 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l"] Jul 08 18:11:30.871448 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:30.871429 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l" Jul 08 18:11:30.874459 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:30.874441 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 18:11:30.875653 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:30.875637 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 18:11:30.875734 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:30.875674 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6gbkt\"" Jul 08 18:11:30.882289 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:30.882266 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l"] Jul 08 18:11:30.957393 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:30.957364 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsshr\" (UniqueName: \"kubernetes.io/projected/a0a9dd32-1626-44bd-8728-4771b658de15-kube-api-access-tsshr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l\" (UID: \"a0a9dd32-1626-44bd-8728-4771b658de15\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l" Jul 08 18:11:30.957523 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:30.957404 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0a9dd32-1626-44bd-8728-4771b658de15-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l\" (UID: \"a0a9dd32-1626-44bd-8728-4771b658de15\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l" Jul 08 18:11:30.957523 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:30.957439 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0a9dd32-1626-44bd-8728-4771b658de15-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l\" (UID: \"a0a9dd32-1626-44bd-8728-4771b658de15\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l" Jul 08 18:11:31.058236 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.058212 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsshr\" (UniqueName: \"kubernetes.io/projected/a0a9dd32-1626-44bd-8728-4771b658de15-kube-api-access-tsshr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l\" (UID: \"a0a9dd32-1626-44bd-8728-4771b658de15\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l" Jul 08 18:11:31.058382 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.058253 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0a9dd32-1626-44bd-8728-4771b658de15-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l\" (UID: \"a0a9dd32-1626-44bd-8728-4771b658de15\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l" Jul 08 18:11:31.058382 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.058292 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0a9dd32-1626-44bd-8728-4771b658de15-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l\" (UID: \"a0a9dd32-1626-44bd-8728-4771b658de15\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l" Jul 08 18:11:31.058622 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.058603 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0a9dd32-1626-44bd-8728-4771b658de15-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l\" (UID: \"a0a9dd32-1626-44bd-8728-4771b658de15\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l" Jul 08 18:11:31.058683 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.058635 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0a9dd32-1626-44bd-8728-4771b658de15-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l\" (UID: \"a0a9dd32-1626-44bd-8728-4771b658de15\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l" Jul 08 18:11:31.068615 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.068596 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsshr\" (UniqueName: \"kubernetes.io/projected/a0a9dd32-1626-44bd-8728-4771b658de15-kube-api-access-tsshr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l\" (UID: \"a0a9dd32-1626-44bd-8728-4771b658de15\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l" Jul 08 18:11:31.099718 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.099691 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-fc95b67c8-ndrxb" podUID="f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b" containerName="console" containerID="cri-o://dab139abed56eaa21a2c0244781b79c1407463668e8652ae2638d628fe955741" gracePeriod=15 Jul 08 18:11:31.180595 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.180571 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l" Jul 08 18:11:31.278343 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.278306 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn"] Jul 08 18:11:31.281940 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.281915 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn" Jul 08 18:11:31.296806 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.296755 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn"] Jul 08 18:11:31.360871 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.360845 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf6nv\" (UniqueName: \"kubernetes.io/projected/2e8ceb91-fa6a-4bbc-9557-523ef3b0081d-kube-api-access-cf6nv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn\" (UID: \"2e8ceb91-fa6a-4bbc-9557-523ef3b0081d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn" Jul 08 18:11:31.360985 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.360911 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e8ceb91-fa6a-4bbc-9557-523ef3b0081d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn\" (UID: \"2e8ceb91-fa6a-4bbc-9557-523ef3b0081d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn" Jul 08 18:11:31.360985 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.360973 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e8ceb91-fa6a-4bbc-9557-523ef3b0081d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn\" (UID: \"2e8ceb91-fa6a-4bbc-9557-523ef3b0081d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn" Jul 08 18:11:31.369507 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.369489 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:11:31.461750 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.461663 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-service-ca\") pod \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " Jul 08 18:11:31.461750 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.461716 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-console-config\") pod \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " Jul 08 18:11:31.461750 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.461746 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-console-serving-cert\") pod \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " Jul 08 18:11:31.461996 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.461773 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6q9vb\" (UniqueName: \"kubernetes.io/projected/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-kube-api-access-6q9vb\") pod \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " Jul 08 18:11:31.461996 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.461790 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-trusted-ca-bundle\") pod \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " Jul 08 18:11:31.461996 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.461829 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-oauth-serving-cert\") pod \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " Jul 08 18:11:31.461996 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.461864 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-console-oauth-config\") pod \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\" (UID: \"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b\") " Jul 08 18:11:31.461996 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.461973 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e8ceb91-fa6a-4bbc-9557-523ef3b0081d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn\" (UID: \"2e8ceb91-fa6a-4bbc-9557-523ef3b0081d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn" Jul 08 18:11:31.462280 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.462007 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-service-ca" (OuterVolumeSpecName: "service-ca") pod "f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b" (UID: "f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:11:31.462280 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.462069 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf6nv\" (UniqueName: \"kubernetes.io/projected/2e8ceb91-fa6a-4bbc-9557-523ef3b0081d-kube-api-access-cf6nv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn\" (UID: \"2e8ceb91-fa6a-4bbc-9557-523ef3b0081d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn" Jul 08 18:11:31.462280 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.462143 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e8ceb91-fa6a-4bbc-9557-523ef3b0081d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn\" (UID: \"2e8ceb91-fa6a-4bbc-9557-523ef3b0081d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn" Jul 08 18:11:31.462280 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.462162 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-console-config" (OuterVolumeSpecName: "console-config") pod "f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b" (UID: "f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:11:31.462280 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.462244 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b" (UID: "f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:11:31.462542 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.462283 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-service-ca\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:11:31.462542 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.462303 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b" (UID: "f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:11:31.462631 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.462559 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e8ceb91-fa6a-4bbc-9557-523ef3b0081d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn\" (UID: \"2e8ceb91-fa6a-4bbc-9557-523ef3b0081d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn" Jul 08 18:11:31.462631 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.462575 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e8ceb91-fa6a-4bbc-9557-523ef3b0081d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn\" (UID: \"2e8ceb91-fa6a-4bbc-9557-523ef3b0081d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn" Jul 08 18:11:31.464068 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.464049 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-kube-api-access-6q9vb" (OuterVolumeSpecName: "kube-api-access-6q9vb") pod "f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b" (UID: "f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b"). InnerVolumeSpecName "kube-api-access-6q9vb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:11:31.464668 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.464648 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b" (UID: "f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:11:31.464719 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.464665 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b" (UID: "f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:11:31.472694 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.472669 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf6nv\" (UniqueName: \"kubernetes.io/projected/2e8ceb91-fa6a-4bbc-9557-523ef3b0081d-kube-api-access-cf6nv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn\" (UID: \"2e8ceb91-fa6a-4bbc-9557-523ef3b0081d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn" Jul 08 18:11:31.534658 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.534627 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l"] Jul 08 18:11:31.540449 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:11:31.540424 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a9dd32_1626_44bd_8728_4771b658de15.slice/crio-26e4b8c40486b2e78bd2435809886bfbe04982dc0fae4c5d8a25081bd6037a4d WatchSource:0}: Error finding container 26e4b8c40486b2e78bd2435809886bfbe04982dc0fae4c5d8a25081bd6037a4d: Status 404 returned error can't find the container with id 26e4b8c40486b2e78bd2435809886bfbe04982dc0fae4c5d8a25081bd6037a4d Jul 08 18:11:31.563586 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.563564 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-oauth-serving-cert\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:11:31.563685 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.563613 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-console-oauth-config\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:11:31.563685 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.563629 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-console-config\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:11:31.563685 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.563644 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-console-serving-cert\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:11:31.563685 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.563657 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6q9vb\" (UniqueName: \"kubernetes.io/projected/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-kube-api-access-6q9vb\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:11:31.563685 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.563670 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b-trusted-ca-bundle\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:11:31.595501 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.595477 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn" Jul 08 18:11:31.655572 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.655546 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs"] Jul 08 18:11:31.655873 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.655862 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b" containerName="console" Jul 08 18:11:31.655916 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.655875 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b" containerName="console" Jul 08 18:11:31.655949 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.655926 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b" containerName="console" Jul 08 18:11:31.658866 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.658846 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs" Jul 08 18:11:31.672848 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.672824 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs"] Jul 08 18:11:31.733895 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.733867 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn"] Jul 08 18:11:31.735871 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:11:31.735846 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e8ceb91_fa6a_4bbc_9557_523ef3b0081d.slice/crio-044dd498e86bcb89de4ff163e19ff81fab7f5efc172d059fa594b5829e357c23 WatchSource:0}: Error finding container 044dd498e86bcb89de4ff163e19ff81fab7f5efc172d059fa594b5829e357c23: Status 404 returned error can't find the container with id 044dd498e86bcb89de4ff163e19ff81fab7f5efc172d059fa594b5829e357c23 Jul 08 18:11:31.765517 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.765479 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1554484-d75d-4638-8342-87f826061280-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs\" (UID: \"b1554484-d75d-4638-8342-87f826061280\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs" Jul 08 18:11:31.765621 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.765601 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhrpl\" (UniqueName: \"kubernetes.io/projected/b1554484-d75d-4638-8342-87f826061280-kube-api-access-lhrpl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs\" (UID: \"b1554484-d75d-4638-8342-87f826061280\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs" Jul 08 18:11:31.765724 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.765705 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1554484-d75d-4638-8342-87f826061280-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs\" (UID: \"b1554484-d75d-4638-8342-87f826061280\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs" Jul 08 18:11:31.866817 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.866786 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhrpl\" (UniqueName: \"kubernetes.io/projected/b1554484-d75d-4638-8342-87f826061280-kube-api-access-lhrpl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs\" (UID: \"b1554484-d75d-4638-8342-87f826061280\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs" Jul 08 18:11:31.866927 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.866834 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1554484-d75d-4638-8342-87f826061280-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs\" (UID: \"b1554484-d75d-4638-8342-87f826061280\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs" Jul 08 18:11:31.866927 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.866867 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1554484-d75d-4638-8342-87f826061280-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs\" (UID: \"b1554484-d75d-4638-8342-87f826061280\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs" Jul 08 18:11:31.867189 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.867174 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1554484-d75d-4638-8342-87f826061280-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs\" (UID: \"b1554484-d75d-4638-8342-87f826061280\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs" Jul 08 18:11:31.867235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.867197 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1554484-d75d-4638-8342-87f826061280-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs\" (UID: \"b1554484-d75d-4638-8342-87f826061280\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs" Jul 08 18:11:31.876334 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.876315 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhrpl\" (UniqueName: \"kubernetes.io/projected/b1554484-d75d-4638-8342-87f826061280-kube-api-access-lhrpl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs\" (UID: \"b1554484-d75d-4638-8342-87f826061280\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs" Jul 08 18:11:31.981665 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:31.981642 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs" Jul 08 18:11:32.087618 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.087588 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k"] Jul 08 18:11:32.091815 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.091794 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k" Jul 08 18:11:32.095880 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.095855 2574 generic.go:356] "Generic (PLEG): container finished" podID="f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b" containerID="dab139abed56eaa21a2c0244781b79c1407463668e8652ae2638d628fe955741" exitCode=0 Jul 08 18:11:32.096006 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.095913 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc95b67c8-ndrxb" Jul 08 18:11:32.096006 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.095966 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc95b67c8-ndrxb" event={"ID":"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b","Type":"ContainerDied","Data":"dab139abed56eaa21a2c0244781b79c1407463668e8652ae2638d628fe955741"} Jul 08 18:11:32.096160 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.096012 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc95b67c8-ndrxb" event={"ID":"f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b","Type":"ContainerDied","Data":"0b65f0a01667dea7702f50fdd59a5cdfaccc3e1907ed6c188e75277d7e1fcaef"} Jul 08 18:11:32.096160 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.096073 2574 scope.go:117] "RemoveContainer" containerID="dab139abed56eaa21a2c0244781b79c1407463668e8652ae2638d628fe955741" Jul 08 18:11:32.098640 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.098400 2574 generic.go:356] "Generic (PLEG): container finished" podID="a0a9dd32-1626-44bd-8728-4771b658de15" containerID="e8ce903012bac8c1133063a1bf2fc2d1b26c1b6abc4ec75ddb4bace555494f08" exitCode=0 Jul 08 18:11:32.098640 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.098438 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l" event={"ID":"a0a9dd32-1626-44bd-8728-4771b658de15","Type":"ContainerDied","Data":"e8ce903012bac8c1133063a1bf2fc2d1b26c1b6abc4ec75ddb4bace555494f08"} Jul 08 18:11:32.098640 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.098496 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l" event={"ID":"a0a9dd32-1626-44bd-8728-4771b658de15","Type":"ContainerStarted","Data":"26e4b8c40486b2e78bd2435809886bfbe04982dc0fae4c5d8a25081bd6037a4d"} Jul 08 18:11:32.100767 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.100748 2574 generic.go:356] "Generic (PLEG): container finished" podID="2e8ceb91-fa6a-4bbc-9557-523ef3b0081d" containerID="94d669be1b0032f40a116fb799313d58566c08d124c1fc465b9d6619ea9ca23d" exitCode=0 Jul 08 18:11:32.100848 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.100815 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn" event={"ID":"2e8ceb91-fa6a-4bbc-9557-523ef3b0081d","Type":"ContainerDied","Data":"94d669be1b0032f40a116fb799313d58566c08d124c1fc465b9d6619ea9ca23d"} Jul 08 18:11:32.100915 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.100854 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn" event={"ID":"2e8ceb91-fa6a-4bbc-9557-523ef3b0081d","Type":"ContainerStarted","Data":"044dd498e86bcb89de4ff163e19ff81fab7f5efc172d059fa594b5829e357c23"} Jul 08 18:11:32.108044 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.107998 2574 scope.go:117] "RemoveContainer" containerID="dab139abed56eaa21a2c0244781b79c1407463668e8652ae2638d628fe955741" Jul 08 18:11:32.108383 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:11:32.108341 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dab139abed56eaa21a2c0244781b79c1407463668e8652ae2638d628fe955741\": container with ID starting with dab139abed56eaa21a2c0244781b79c1407463668e8652ae2638d628fe955741 not found: ID does not exist" containerID="dab139abed56eaa21a2c0244781b79c1407463668e8652ae2638d628fe955741" Jul 08 18:11:32.108474 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.108391 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dab139abed56eaa21a2c0244781b79c1407463668e8652ae2638d628fe955741"} err="failed to get container status \"dab139abed56eaa21a2c0244781b79c1407463668e8652ae2638d628fe955741\": rpc error: code = NotFound desc = could not find container \"dab139abed56eaa21a2c0244781b79c1407463668e8652ae2638d628fe955741\": container with ID starting with dab139abed56eaa21a2c0244781b79c1407463668e8652ae2638d628fe955741 not found: ID does not exist" Jul 08 18:11:32.108474 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.108424 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k"] Jul 08 18:11:32.127122 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.127101 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs"] Jul 08 18:11:32.128633 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:11:32.128609 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1554484_d75d_4638_8342_87f826061280.slice/crio-7d8259fe624152180f87e1d06a277a954db5621f2bbe3264eaf10e3454e953b8 WatchSource:0}: Error finding container 7d8259fe624152180f87e1d06a277a954db5621f2bbe3264eaf10e3454e953b8: Status 404 returned error can't find the container with id 7d8259fe624152180f87e1d06a277a954db5621f2bbe3264eaf10e3454e953b8 Jul 08 18:11:32.169015 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.168992 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98f8c692-9bf5-4328-830d-4b95d4ad2e00-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k\" (UID: \"98f8c692-9bf5-4328-830d-4b95d4ad2e00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k" Jul 08 18:11:32.169123 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.169087 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7tr2\" (UniqueName: \"kubernetes.io/projected/98f8c692-9bf5-4328-830d-4b95d4ad2e00-kube-api-access-j7tr2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k\" (UID: \"98f8c692-9bf5-4328-830d-4b95d4ad2e00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k" Jul 08 18:11:32.169198 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.169122 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98f8c692-9bf5-4328-830d-4b95d4ad2e00-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k\" (UID: \"98f8c692-9bf5-4328-830d-4b95d4ad2e00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k" Jul 08 18:11:32.182807 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.182786 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fc95b67c8-ndrxb"] Jul 08 18:11:32.191366 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.191340 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fc95b67c8-ndrxb"] Jul 08 18:11:32.269653 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.269594 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7tr2\" (UniqueName: \"kubernetes.io/projected/98f8c692-9bf5-4328-830d-4b95d4ad2e00-kube-api-access-j7tr2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k\" (UID: \"98f8c692-9bf5-4328-830d-4b95d4ad2e00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k" Jul 08 18:11:32.269653 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.269630 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98f8c692-9bf5-4328-830d-4b95d4ad2e00-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k\" (UID: \"98f8c692-9bf5-4328-830d-4b95d4ad2e00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k" Jul 08 18:11:32.269824 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.269716 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98f8c692-9bf5-4328-830d-4b95d4ad2e00-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k\" (UID: \"98f8c692-9bf5-4328-830d-4b95d4ad2e00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k" Jul 08 18:11:32.270055 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.270013 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98f8c692-9bf5-4328-830d-4b95d4ad2e00-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k\" (UID: \"98f8c692-9bf5-4328-830d-4b95d4ad2e00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k" Jul 08 18:11:32.270140 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.270096 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98f8c692-9bf5-4328-830d-4b95d4ad2e00-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k\" (UID: \"98f8c692-9bf5-4328-830d-4b95d4ad2e00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k" Jul 08 18:11:32.271935 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.271913 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b" path="/var/lib/kubelet/pods/f2aa2ef4-b9f0-4eb7-aaa5-42c5d96f727b/volumes" Jul 08 18:11:32.281898 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.281880 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7tr2\" (UniqueName: \"kubernetes.io/projected/98f8c692-9bf5-4328-830d-4b95d4ad2e00-kube-api-access-j7tr2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k\" (UID: \"98f8c692-9bf5-4328-830d-4b95d4ad2e00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k" Jul 08 18:11:32.403129 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.403100 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k" Jul 08 18:11:32.539875 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:32.539848 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k"] Jul 08 18:11:32.541533 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:11:32.541513 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f8c692_9bf5_4328_830d_4b95d4ad2e00.slice/crio-aa4a22a15490a3d56a1da50de79fcb4c312e1ea2204487c728bdf99fd77b9c1e WatchSource:0}: Error finding container aa4a22a15490a3d56a1da50de79fcb4c312e1ea2204487c728bdf99fd77b9c1e: Status 404 returned error can't find the container with id aa4a22a15490a3d56a1da50de79fcb4c312e1ea2204487c728bdf99fd77b9c1e Jul 08 18:11:33.108475 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:33.108440 2574 generic.go:356] "Generic (PLEG): container finished" podID="b1554484-d75d-4638-8342-87f826061280" containerID="a2974d4f01261b4bb0e6dd25cab15142b343404c791662b9a4c7e21890bb75e0" exitCode=0 Jul 08 18:11:33.108858 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:33.108522 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs" event={"ID":"b1554484-d75d-4638-8342-87f826061280","Type":"ContainerDied","Data":"a2974d4f01261b4bb0e6dd25cab15142b343404c791662b9a4c7e21890bb75e0"} Jul 08 18:11:33.108858 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:33.108578 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs" event={"ID":"b1554484-d75d-4638-8342-87f826061280","Type":"ContainerStarted","Data":"7d8259fe624152180f87e1d06a277a954db5621f2bbe3264eaf10e3454e953b8"} Jul 08 18:11:33.110605 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:33.110571 2574 generic.go:356] "Generic (PLEG): container finished" podID="98f8c692-9bf5-4328-830d-4b95d4ad2e00" containerID="79dfff6d933d46b08e71a3edbd2c7f6a56257c127c47fa102c8b848f7cc75866" exitCode=0 Jul 08 18:11:33.110711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:33.110672 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k" event={"ID":"98f8c692-9bf5-4328-830d-4b95d4ad2e00","Type":"ContainerDied","Data":"79dfff6d933d46b08e71a3edbd2c7f6a56257c127c47fa102c8b848f7cc75866"} Jul 08 18:11:33.110711 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:33.110706 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k" event={"ID":"98f8c692-9bf5-4328-830d-4b95d4ad2e00","Type":"ContainerStarted","Data":"aa4a22a15490a3d56a1da50de79fcb4c312e1ea2204487c728bdf99fd77b9c1e"} Jul 08 18:11:33.113850 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:33.113831 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l" event={"ID":"a0a9dd32-1626-44bd-8728-4771b658de15","Type":"ContainerStarted","Data":"01a1bb48bf7674f7f4b642cd043880c40e676354803947d5b128971b7061f36f"} Jul 08 18:11:34.120346 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:34.120318 2574 generic.go:356] "Generic (PLEG): container finished" podID="b1554484-d75d-4638-8342-87f826061280" containerID="e249cf4eed511d43aa496b81c3b7dfc321d2e76900349d05d04a6daa19a7db31" exitCode=0 Jul 08 18:11:34.120679 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:34.120392 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs" event={"ID":"b1554484-d75d-4638-8342-87f826061280","Type":"ContainerDied","Data":"e249cf4eed511d43aa496b81c3b7dfc321d2e76900349d05d04a6daa19a7db31"} Jul 08 18:11:34.122271 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:34.122248 2574 generic.go:356] "Generic (PLEG): container finished" podID="98f8c692-9bf5-4328-830d-4b95d4ad2e00" containerID="f94bf570a1f5ca6d04a70e15c789bcc7d763baaeb55b7a05c1bd004ed6ed4f09" exitCode=0 Jul 08 18:11:34.122366 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:34.122329 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k" event={"ID":"98f8c692-9bf5-4328-830d-4b95d4ad2e00","Type":"ContainerDied","Data":"f94bf570a1f5ca6d04a70e15c789bcc7d763baaeb55b7a05c1bd004ed6ed4f09"} Jul 08 18:11:34.124219 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:34.124199 2574 generic.go:356] "Generic (PLEG): container finished" podID="a0a9dd32-1626-44bd-8728-4771b658de15" containerID="01a1bb48bf7674f7f4b642cd043880c40e676354803947d5b128971b7061f36f" exitCode=0 Jul 08 18:11:34.124305 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:34.124276 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l" event={"ID":"a0a9dd32-1626-44bd-8728-4771b658de15","Type":"ContainerDied","Data":"01a1bb48bf7674f7f4b642cd043880c40e676354803947d5b128971b7061f36f"} Jul 08 18:11:34.126147 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:34.126129 2574 generic.go:356] "Generic (PLEG): container finished" podID="2e8ceb91-fa6a-4bbc-9557-523ef3b0081d" containerID="2c671fab6f0ecc76bdd0d258db3b753918046460df7cf01312c2afad3540630d" exitCode=0 Jul 08 18:11:34.126227 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:34.126155 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn" event={"ID":"2e8ceb91-fa6a-4bbc-9557-523ef3b0081d","Type":"ContainerDied","Data":"2c671fab6f0ecc76bdd0d258db3b753918046460df7cf01312c2afad3540630d"} Jul 08 18:11:35.134614 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:35.134575 2574 generic.go:356] "Generic (PLEG): container finished" podID="2e8ceb91-fa6a-4bbc-9557-523ef3b0081d" containerID="f9fba9d1fdd5ec3891b6e63bc9377cee2b390dc3de079eadc2a928efbdcdb46e" exitCode=0 Jul 08 18:11:35.135071 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:35.134651 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn" event={"ID":"2e8ceb91-fa6a-4bbc-9557-523ef3b0081d","Type":"ContainerDied","Data":"f9fba9d1fdd5ec3891b6e63bc9377cee2b390dc3de079eadc2a928efbdcdb46e"} Jul 08 18:11:35.137290 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:35.137258 2574 generic.go:356] "Generic (PLEG): container finished" podID="b1554484-d75d-4638-8342-87f826061280" containerID="594e9e4d2f76e74c762a0c6352e7cf84c82d9a09f6304a146e408a7b9ae8eb1e" exitCode=0 Jul 08 18:11:35.137399 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:35.137345 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs" event={"ID":"b1554484-d75d-4638-8342-87f826061280","Type":"ContainerDied","Data":"594e9e4d2f76e74c762a0c6352e7cf84c82d9a09f6304a146e408a7b9ae8eb1e"} Jul 08 18:11:35.139967 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:35.139931 2574 generic.go:356] "Generic (PLEG): container finished" podID="98f8c692-9bf5-4328-830d-4b95d4ad2e00" containerID="553264259e2b4f75d331371d6925a3e1bf899599c952544d24816e36e87132f9" exitCode=0 Jul 08 18:11:35.140097 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:35.139986 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k" event={"ID":"98f8c692-9bf5-4328-830d-4b95d4ad2e00","Type":"ContainerDied","Data":"553264259e2b4f75d331371d6925a3e1bf899599c952544d24816e36e87132f9"} Jul 08 18:11:35.142325 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:35.142294 2574 generic.go:356] "Generic (PLEG): container finished" podID="a0a9dd32-1626-44bd-8728-4771b658de15" containerID="926bf834397bdd9664f1e05e44a1bac007e9456bac08e7a5721bafeb326e80d7" exitCode=0 Jul 08 18:11:35.142415 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:35.142335 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l" event={"ID":"a0a9dd32-1626-44bd-8728-4771b658de15","Type":"ContainerDied","Data":"926bf834397bdd9664f1e05e44a1bac007e9456bac08e7a5721bafeb326e80d7"} Jul 08 18:11:36.293873 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.293850 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs" Jul 08 18:11:36.340958 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.340925 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn" Jul 08 18:11:36.344486 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.344466 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l" Jul 08 18:11:36.347699 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.347672 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k" Jul 08 18:11:36.403196 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.403130 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsshr\" (UniqueName: \"kubernetes.io/projected/a0a9dd32-1626-44bd-8728-4771b658de15-kube-api-access-tsshr\") pod \"a0a9dd32-1626-44bd-8728-4771b658de15\" (UID: \"a0a9dd32-1626-44bd-8728-4771b658de15\") " Jul 08 18:11:36.403196 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.403162 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0a9dd32-1626-44bd-8728-4771b658de15-bundle\") pod \"a0a9dd32-1626-44bd-8728-4771b658de15\" (UID: \"a0a9dd32-1626-44bd-8728-4771b658de15\") " Jul 08 18:11:36.403196 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.403185 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0a9dd32-1626-44bd-8728-4771b658de15-util\") pod \"a0a9dd32-1626-44bd-8728-4771b658de15\" (UID: \"a0a9dd32-1626-44bd-8728-4771b658de15\") " Jul 08 18:11:36.403427 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.403212 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1554484-d75d-4638-8342-87f826061280-bundle\") pod \"b1554484-d75d-4638-8342-87f826061280\" (UID: \"b1554484-d75d-4638-8342-87f826061280\") " Jul 08 18:11:36.403427 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.403270 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e8ceb91-fa6a-4bbc-9557-523ef3b0081d-bundle\") pod \"2e8ceb91-fa6a-4bbc-9557-523ef3b0081d\" (UID: \"2e8ceb91-fa6a-4bbc-9557-523ef3b0081d\") " Jul 08 18:11:36.403427 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.403299 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e8ceb91-fa6a-4bbc-9557-523ef3b0081d-util\") pod \"2e8ceb91-fa6a-4bbc-9557-523ef3b0081d\" (UID: \"2e8ceb91-fa6a-4bbc-9557-523ef3b0081d\") " Jul 08 18:11:36.403427 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.403324 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7tr2\" (UniqueName: \"kubernetes.io/projected/98f8c692-9bf5-4328-830d-4b95d4ad2e00-kube-api-access-j7tr2\") pod \"98f8c692-9bf5-4328-830d-4b95d4ad2e00\" (UID: \"98f8c692-9bf5-4328-830d-4b95d4ad2e00\") " Jul 08 18:11:36.403427 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.403359 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98f8c692-9bf5-4328-830d-4b95d4ad2e00-util\") pod \"98f8c692-9bf5-4328-830d-4b95d4ad2e00\" (UID: \"98f8c692-9bf5-4328-830d-4b95d4ad2e00\") " Jul 08 18:11:36.403427 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.403384 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cf6nv\" (UniqueName: \"kubernetes.io/projected/2e8ceb91-fa6a-4bbc-9557-523ef3b0081d-kube-api-access-cf6nv\") pod \"2e8ceb91-fa6a-4bbc-9557-523ef3b0081d\" (UID: \"2e8ceb91-fa6a-4bbc-9557-523ef3b0081d\") " Jul 08 18:11:36.403722 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.403430 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhrpl\" (UniqueName: \"kubernetes.io/projected/b1554484-d75d-4638-8342-87f826061280-kube-api-access-lhrpl\") pod \"b1554484-d75d-4638-8342-87f826061280\" (UID: \"b1554484-d75d-4638-8342-87f826061280\") " Jul 08 18:11:36.403722 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.403455 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1554484-d75d-4638-8342-87f826061280-util\") pod \"b1554484-d75d-4638-8342-87f826061280\" (UID: \"b1554484-d75d-4638-8342-87f826061280\") " Jul 08 18:11:36.403722 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.403504 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98f8c692-9bf5-4328-830d-4b95d4ad2e00-bundle\") pod \"98f8c692-9bf5-4328-830d-4b95d4ad2e00\" (UID: \"98f8c692-9bf5-4328-830d-4b95d4ad2e00\") " Jul 08 18:11:36.403871 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.403854 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0a9dd32-1626-44bd-8728-4771b658de15-bundle" (OuterVolumeSpecName: "bundle") pod "a0a9dd32-1626-44bd-8728-4771b658de15" (UID: "a0a9dd32-1626-44bd-8728-4771b658de15"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:11:36.403996 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.403973 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1554484-d75d-4638-8342-87f826061280-bundle" (OuterVolumeSpecName: "bundle") pod "b1554484-d75d-4638-8342-87f826061280" (UID: "b1554484-d75d-4638-8342-87f826061280"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:11:36.404525 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.404500 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98f8c692-9bf5-4328-830d-4b95d4ad2e00-bundle" (OuterVolumeSpecName: "bundle") pod "98f8c692-9bf5-4328-830d-4b95d4ad2e00" (UID: "98f8c692-9bf5-4328-830d-4b95d4ad2e00"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:11:36.404650 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.404350 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e8ceb91-fa6a-4bbc-9557-523ef3b0081d-bundle" (OuterVolumeSpecName: "bundle") pod "2e8ceb91-fa6a-4bbc-9557-523ef3b0081d" (UID: "2e8ceb91-fa6a-4bbc-9557-523ef3b0081d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:11:36.407419 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.407393 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98f8c692-9bf5-4328-830d-4b95d4ad2e00-kube-api-access-j7tr2" (OuterVolumeSpecName: "kube-api-access-j7tr2") pod "98f8c692-9bf5-4328-830d-4b95d4ad2e00" (UID: "98f8c692-9bf5-4328-830d-4b95d4ad2e00"). InnerVolumeSpecName "kube-api-access-j7tr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:11:36.407516 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.407431 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1554484-d75d-4638-8342-87f826061280-kube-api-access-lhrpl" (OuterVolumeSpecName: "kube-api-access-lhrpl") pod "b1554484-d75d-4638-8342-87f826061280" (UID: "b1554484-d75d-4638-8342-87f826061280"). InnerVolumeSpecName "kube-api-access-lhrpl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:11:36.407650 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.407627 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e8ceb91-fa6a-4bbc-9557-523ef3b0081d-kube-api-access-cf6nv" (OuterVolumeSpecName: "kube-api-access-cf6nv") pod "2e8ceb91-fa6a-4bbc-9557-523ef3b0081d" (UID: "2e8ceb91-fa6a-4bbc-9557-523ef3b0081d"). InnerVolumeSpecName "kube-api-access-cf6nv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:11:36.411565 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.411534 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0a9dd32-1626-44bd-8728-4771b658de15-kube-api-access-tsshr" (OuterVolumeSpecName: "kube-api-access-tsshr") pod "a0a9dd32-1626-44bd-8728-4771b658de15" (UID: "a0a9dd32-1626-44bd-8728-4771b658de15"). InnerVolumeSpecName "kube-api-access-tsshr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:11:36.411852 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.411826 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0a9dd32-1626-44bd-8728-4771b658de15-util" (OuterVolumeSpecName: "util") pod "a0a9dd32-1626-44bd-8728-4771b658de15" (UID: "a0a9dd32-1626-44bd-8728-4771b658de15"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:11:36.412403 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.412380 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e8ceb91-fa6a-4bbc-9557-523ef3b0081d-util" (OuterVolumeSpecName: "util") pod "2e8ceb91-fa6a-4bbc-9557-523ef3b0081d" (UID: "2e8ceb91-fa6a-4bbc-9557-523ef3b0081d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:11:36.413669 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.413645 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98f8c692-9bf5-4328-830d-4b95d4ad2e00-util" (OuterVolumeSpecName: "util") pod "98f8c692-9bf5-4328-830d-4b95d4ad2e00" (UID: "98f8c692-9bf5-4328-830d-4b95d4ad2e00"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:11:36.414395 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.414356 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1554484-d75d-4638-8342-87f826061280-util" (OuterVolumeSpecName: "util") pod "b1554484-d75d-4638-8342-87f826061280" (UID: "b1554484-d75d-4638-8342-87f826061280"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:11:36.504312 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.504286 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e8ceb91-fa6a-4bbc-9557-523ef3b0081d-bundle\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:11:36.504312 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.504308 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e8ceb91-fa6a-4bbc-9557-523ef3b0081d-util\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:11:36.504441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.504316 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7tr2\" (UniqueName: \"kubernetes.io/projected/98f8c692-9bf5-4328-830d-4b95d4ad2e00-kube-api-access-j7tr2\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:11:36.504441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.504326 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98f8c692-9bf5-4328-830d-4b95d4ad2e00-util\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:11:36.504441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.504334 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cf6nv\" (UniqueName: \"kubernetes.io/projected/2e8ceb91-fa6a-4bbc-9557-523ef3b0081d-kube-api-access-cf6nv\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:11:36.504441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.504342 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhrpl\" (UniqueName: \"kubernetes.io/projected/b1554484-d75d-4638-8342-87f826061280-kube-api-access-lhrpl\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:11:36.504441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.504351 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1554484-d75d-4638-8342-87f826061280-util\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:11:36.504441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.504358 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98f8c692-9bf5-4328-830d-4b95d4ad2e00-bundle\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:11:36.504441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.504367 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsshr\" (UniqueName: \"kubernetes.io/projected/a0a9dd32-1626-44bd-8728-4771b658de15-kube-api-access-tsshr\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:11:36.504441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.504376 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0a9dd32-1626-44bd-8728-4771b658de15-bundle\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:11:36.504441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.504384 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0a9dd32-1626-44bd-8728-4771b658de15-util\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:11:36.504441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:36.504391 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1554484-d75d-4638-8342-87f826061280-bundle\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:11:37.154883 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:37.154848 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn" Jul 08 18:11:37.155099 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:37.154846 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn" event={"ID":"2e8ceb91-fa6a-4bbc-9557-523ef3b0081d","Type":"ContainerDied","Data":"044dd498e86bcb89de4ff163e19ff81fab7f5efc172d059fa594b5829e357c23"} Jul 08 18:11:37.155099 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:37.155061 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="044dd498e86bcb89de4ff163e19ff81fab7f5efc172d059fa594b5829e357c23" Jul 08 18:11:37.157009 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:37.156985 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs" Jul 08 18:11:37.157190 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:37.157012 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs" event={"ID":"b1554484-d75d-4638-8342-87f826061280","Type":"ContainerDied","Data":"7d8259fe624152180f87e1d06a277a954db5621f2bbe3264eaf10e3454e953b8"} Jul 08 18:11:37.157190 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:37.157090 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d8259fe624152180f87e1d06a277a954db5621f2bbe3264eaf10e3454e953b8" Jul 08 18:11:37.159491 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:37.159468 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k" Jul 08 18:11:37.159491 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:37.159478 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k" event={"ID":"98f8c692-9bf5-4328-830d-4b95d4ad2e00","Type":"ContainerDied","Data":"aa4a22a15490a3d56a1da50de79fcb4c312e1ea2204487c728bdf99fd77b9c1e"} Jul 08 18:11:37.159647 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:37.159525 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa4a22a15490a3d56a1da50de79fcb4c312e1ea2204487c728bdf99fd77b9c1e" Jul 08 18:11:37.161818 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:37.161791 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l" event={"ID":"a0a9dd32-1626-44bd-8728-4771b658de15","Type":"ContainerDied","Data":"26e4b8c40486b2e78bd2435809886bfbe04982dc0fae4c5d8a25081bd6037a4d"} Jul 08 18:11:37.161918 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:37.161835 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26e4b8c40486b2e78bd2435809886bfbe04982dc0fae4c5d8a25081bd6037a4d" Jul 08 18:11:37.161918 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:11:37.161849 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l" Jul 08 18:12:12.178332 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178300 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7"] Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178585 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1554484-d75d-4638-8342-87f826061280" containerName="extract" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178597 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1554484-d75d-4638-8342-87f826061280" containerName="extract" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178607 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1554484-d75d-4638-8342-87f826061280" containerName="util" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178613 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1554484-d75d-4638-8342-87f826061280" containerName="util" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178620 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a9dd32-1626-44bd-8728-4771b658de15" containerName="pull" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178626 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a9dd32-1626-44bd-8728-4771b658de15" containerName="pull" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178633 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98f8c692-9bf5-4328-830d-4b95d4ad2e00" containerName="util" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178638 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="98f8c692-9bf5-4328-830d-4b95d4ad2e00" containerName="util" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178645 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1554484-d75d-4638-8342-87f826061280" containerName="pull" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178649 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1554484-d75d-4638-8342-87f826061280" containerName="pull" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178658 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e8ceb91-fa6a-4bbc-9557-523ef3b0081d" containerName="extract" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178665 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e8ceb91-fa6a-4bbc-9557-523ef3b0081d" containerName="extract" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178677 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a9dd32-1626-44bd-8728-4771b658de15" containerName="util" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178684 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a9dd32-1626-44bd-8728-4771b658de15" containerName="util" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178698 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e8ceb91-fa6a-4bbc-9557-523ef3b0081d" containerName="util" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178706 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e8ceb91-fa6a-4bbc-9557-523ef3b0081d" containerName="util" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178714 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a9dd32-1626-44bd-8728-4771b658de15" containerName="extract" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178722 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a9dd32-1626-44bd-8728-4771b658de15" containerName="extract" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178735 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98f8c692-9bf5-4328-830d-4b95d4ad2e00" containerName="pull" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178743 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="98f8c692-9bf5-4328-830d-4b95d4ad2e00" containerName="pull" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178753 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e8ceb91-fa6a-4bbc-9557-523ef3b0081d" containerName="pull" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178760 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e8ceb91-fa6a-4bbc-9557-523ef3b0081d" containerName="pull" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178767 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98f8c692-9bf5-4328-830d-4b95d4ad2e00" containerName="extract" Jul 08 18:12:12.178778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178775 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="98f8c692-9bf5-4328-830d-4b95d4ad2e00" containerName="extract" Jul 08 18:12:12.179529 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178849 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1554484-d75d-4638-8342-87f826061280" containerName="extract" Jul 08 18:12:12.179529 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178859 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0a9dd32-1626-44bd-8728-4771b658de15" containerName="extract" Jul 08 18:12:12.179529 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178870 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="98f8c692-9bf5-4328-830d-4b95d4ad2e00" containerName="extract" Jul 08 18:12:12.179529 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.178881 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e8ceb91-fa6a-4bbc-9557-523ef3b0081d" containerName="extract" Jul 08 18:12:12.183152 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.183132 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7" Jul 08 18:12:12.189452 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.189281 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 18:12:12.189537 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.189513 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 18:12:12.189599 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.189516 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gxlrs\"" Jul 08 18:12:12.206545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.206521 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7"] Jul 08 18:12:12.361916 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.361891 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v85f\" (UniqueName: \"kubernetes.io/projected/5cf83148-673f-4d3e-b8c6-88264728f7c8-kube-api-access-4v85f\") pod \"kuadrant-operator-controller-manager-86878c769f-wz2p7\" (UID: \"5cf83148-673f-4d3e-b8c6-88264728f7c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7" Jul 08 18:12:12.362083 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.361933 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cf83148-673f-4d3e-b8c6-88264728f7c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wz2p7\" (UID: \"5cf83148-673f-4d3e-b8c6-88264728f7c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7" Jul 08 18:12:12.462508 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.462436 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v85f\" (UniqueName: \"kubernetes.io/projected/5cf83148-673f-4d3e-b8c6-88264728f7c8-kube-api-access-4v85f\") pod \"kuadrant-operator-controller-manager-86878c769f-wz2p7\" (UID: \"5cf83148-673f-4d3e-b8c6-88264728f7c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7" Jul 08 18:12:12.462508 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.462491 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cf83148-673f-4d3e-b8c6-88264728f7c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wz2p7\" (UID: \"5cf83148-673f-4d3e-b8c6-88264728f7c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7" Jul 08 18:12:12.462872 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.462850 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cf83148-673f-4d3e-b8c6-88264728f7c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wz2p7\" (UID: \"5cf83148-673f-4d3e-b8c6-88264728f7c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7" Jul 08 18:12:12.484869 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.484838 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v85f\" (UniqueName: \"kubernetes.io/projected/5cf83148-673f-4d3e-b8c6-88264728f7c8-kube-api-access-4v85f\") pod \"kuadrant-operator-controller-manager-86878c769f-wz2p7\" (UID: \"5cf83148-673f-4d3e-b8c6-88264728f7c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7" Jul 08 18:12:12.492979 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.492958 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7" Jul 08 18:12:12.636956 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:12.636930 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7"] Jul 08 18:12:13.333261 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:13.333216 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7" event={"ID":"5cf83148-673f-4d3e-b8c6-88264728f7c8","Type":"ContainerStarted","Data":"c7ceb83dd0475929a2d0003f36e8e238e5593a9bac27d1c37819515eb14ff7ae"} Jul 08 18:12:20.367529 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:20.367498 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7" event={"ID":"5cf83148-673f-4d3e-b8c6-88264728f7c8","Type":"ContainerStarted","Data":"aee6bdf5e31c40241f3a268b3f763f3f7fa5976575cb7cff1b7257996e2c982d"} Jul 08 18:12:20.367871 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:20.367633 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7" Jul 08 18:12:20.401054 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:20.400996 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7" podStartSLOduration=0.770374906 podStartE2EDuration="8.400981712s" totalImagesPullingTime="7.630606806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:12:20.397292678 +0000 UTC m=+474.641190843" watchObservedRunningTime="2026-07-08 18:12:20.400981712 +0000 UTC m=+474.644880254" Jul 08 18:12:31.374011 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:12:31.373980 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7" Jul 08 18:13:32.327396 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:32.327316 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-867d5bdd4f-8qpww"] Jul 08 18:13:32.330059 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:32.330040 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-867d5bdd4f-8qpww" Jul 08 18:13:32.333813 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:32.333786 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 08 18:13:32.333947 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:32.333930 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 08 18:13:32.334095 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:32.334083 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-r4szr\"" Jul 08 18:13:32.344583 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:32.344561 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-867d5bdd4f-8qpww"] Jul 08 18:13:32.447577 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:32.447552 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsnh4\" (UniqueName: \"kubernetes.io/projected/4e7f9a93-3798-4477-9416-c96fd80f795e-kube-api-access-tsnh4\") pod \"maas-controller-867d5bdd4f-8qpww\" (UID: \"4e7f9a93-3798-4477-9416-c96fd80f795e\") " pod="opendatahub/maas-controller-867d5bdd4f-8qpww" Jul 08 18:13:32.447699 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:32.447613 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e7f9a93-3798-4477-9416-c96fd80f795e-webhook-cert\") pod \"maas-controller-867d5bdd4f-8qpww\" (UID: \"4e7f9a93-3798-4477-9416-c96fd80f795e\") " pod="opendatahub/maas-controller-867d5bdd4f-8qpww" Jul 08 18:13:32.548768 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:32.548737 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsnh4\" (UniqueName: \"kubernetes.io/projected/4e7f9a93-3798-4477-9416-c96fd80f795e-kube-api-access-tsnh4\") pod \"maas-controller-867d5bdd4f-8qpww\" (UID: \"4e7f9a93-3798-4477-9416-c96fd80f795e\") " pod="opendatahub/maas-controller-867d5bdd4f-8qpww" Jul 08 18:13:32.548902 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:32.548817 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e7f9a93-3798-4477-9416-c96fd80f795e-webhook-cert\") pod \"maas-controller-867d5bdd4f-8qpww\" (UID: \"4e7f9a93-3798-4477-9416-c96fd80f795e\") " pod="opendatahub/maas-controller-867d5bdd4f-8qpww" Jul 08 18:13:32.548952 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:13:32.548939 2574 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 08 18:13:32.549046 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:13:32.549015 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e7f9a93-3798-4477-9416-c96fd80f795e-webhook-cert podName:4e7f9a93-3798-4477-9416-c96fd80f795e nodeName:}" failed. No retries permitted until 2026-07-08 18:13:33.048994652 +0000 UTC m=+547.292892800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/4e7f9a93-3798-4477-9416-c96fd80f795e-webhook-cert") pod "maas-controller-867d5bdd4f-8qpww" (UID: "4e7f9a93-3798-4477-9416-c96fd80f795e") : secret "maas-controller-webhook-cert" not found Jul 08 18:13:32.557792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:32.557766 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsnh4\" (UniqueName: \"kubernetes.io/projected/4e7f9a93-3798-4477-9416-c96fd80f795e-kube-api-access-tsnh4\") pod \"maas-controller-867d5bdd4f-8qpww\" (UID: \"4e7f9a93-3798-4477-9416-c96fd80f795e\") " pod="opendatahub/maas-controller-867d5bdd4f-8qpww" Jul 08 18:13:33.053629 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:33.053597 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e7f9a93-3798-4477-9416-c96fd80f795e-webhook-cert\") pod \"maas-controller-867d5bdd4f-8qpww\" (UID: \"4e7f9a93-3798-4477-9416-c96fd80f795e\") " pod="opendatahub/maas-controller-867d5bdd4f-8qpww" Jul 08 18:13:33.056416 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:33.056389 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e7f9a93-3798-4477-9416-c96fd80f795e-webhook-cert\") pod \"maas-controller-867d5bdd4f-8qpww\" (UID: \"4e7f9a93-3798-4477-9416-c96fd80f795e\") " pod="opendatahub/maas-controller-867d5bdd4f-8qpww" Jul 08 18:13:33.239455 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:33.239430 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-867d5bdd4f-8qpww" Jul 08 18:13:33.378705 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:33.378679 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-867d5bdd4f-8qpww"] Jul 08 18:13:33.380270 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:13:33.380244 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e7f9a93_3798_4477_9416_c96fd80f795e.slice/crio-72f93b86c743486e468ac6b7c359e66045f82955bb1234d1b13f27d29f21b060 WatchSource:0}: Error finding container 72f93b86c743486e468ac6b7c359e66045f82955bb1234d1b13f27d29f21b060: Status 404 returned error can't find the container with id 72f93b86c743486e468ac6b7c359e66045f82955bb1234d1b13f27d29f21b060 Jul 08 18:13:33.731409 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:33.731376 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-867d5bdd4f-8qpww" event={"ID":"4e7f9a93-3798-4477-9416-c96fd80f795e","Type":"ContainerStarted","Data":"72f93b86c743486e468ac6b7c359e66045f82955bb1234d1b13f27d29f21b060"} Jul 08 18:13:35.742580 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:35.742546 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-867d5bdd4f-8qpww" event={"ID":"4e7f9a93-3798-4477-9416-c96fd80f795e","Type":"ContainerStarted","Data":"f0179d5d95e42f60a581e08468510e1232dcf3f27fec7760e5f35e4c13f55592"} Jul 08 18:13:35.742951 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:35.742631 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-867d5bdd4f-8qpww" Jul 08 18:13:35.767419 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:35.767368 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-867d5bdd4f-8qpww" podStartSLOduration=1.504539513 podStartE2EDuration="3.767350039s" totalImagesPullingTime="2.262810526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:13:35.766055117 +0000 UTC m=+550.009953274" watchObservedRunningTime="2026-07-08 18:13:35.767350039 +0000 UTC m=+550.011248205" Jul 08 18:13:46.753760 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:46.753724 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-867d5bdd4f-8qpww" Jul 08 18:13:47.558745 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:47.558712 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-867d5bdd4f-8qpww"] Jul 08 18:13:47.558929 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:47.558876 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-867d5bdd4f-8qpww" podUID="4e7f9a93-3798-4477-9416-c96fd80f795e" containerName="manager" containerID="cri-o://f0179d5d95e42f60a581e08468510e1232dcf3f27fec7760e5f35e4c13f55592" gracePeriod=30 Jul 08 18:13:47.799794 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:47.799772 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-867d5bdd4f-8qpww" Jul 08 18:13:47.801321 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:47.801293 2574 generic.go:356] "Generic (PLEG): container finished" podID="4e7f9a93-3798-4477-9416-c96fd80f795e" containerID="f0179d5d95e42f60a581e08468510e1232dcf3f27fec7760e5f35e4c13f55592" exitCode=0 Jul 08 18:13:47.801419 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:47.801329 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-867d5bdd4f-8qpww" Jul 08 18:13:47.801419 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:47.801370 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-867d5bdd4f-8qpww" event={"ID":"4e7f9a93-3798-4477-9416-c96fd80f795e","Type":"ContainerDied","Data":"f0179d5d95e42f60a581e08468510e1232dcf3f27fec7760e5f35e4c13f55592"} Jul 08 18:13:47.801419 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:47.801415 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-867d5bdd4f-8qpww" event={"ID":"4e7f9a93-3798-4477-9416-c96fd80f795e","Type":"ContainerDied","Data":"72f93b86c743486e468ac6b7c359e66045f82955bb1234d1b13f27d29f21b060"} Jul 08 18:13:47.801521 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:47.801435 2574 scope.go:117] "RemoveContainer" containerID="f0179d5d95e42f60a581e08468510e1232dcf3f27fec7760e5f35e4c13f55592" Jul 08 18:13:47.809518 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:47.809498 2574 scope.go:117] "RemoveContainer" containerID="f0179d5d95e42f60a581e08468510e1232dcf3f27fec7760e5f35e4c13f55592" Jul 08 18:13:47.809760 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:13:47.809742 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0179d5d95e42f60a581e08468510e1232dcf3f27fec7760e5f35e4c13f55592\": container with ID starting with f0179d5d95e42f60a581e08468510e1232dcf3f27fec7760e5f35e4c13f55592 not found: ID does not exist" containerID="f0179d5d95e42f60a581e08468510e1232dcf3f27fec7760e5f35e4c13f55592" Jul 08 18:13:47.809820 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:47.809769 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0179d5d95e42f60a581e08468510e1232dcf3f27fec7760e5f35e4c13f55592"} err="failed to get container status \"f0179d5d95e42f60a581e08468510e1232dcf3f27fec7760e5f35e4c13f55592\": rpc error: code = NotFound desc = could not find container \"f0179d5d95e42f60a581e08468510e1232dcf3f27fec7760e5f35e4c13f55592\": container with ID starting with f0179d5d95e42f60a581e08468510e1232dcf3f27fec7760e5f35e4c13f55592 not found: ID does not exist" Jul 08 18:13:47.862548 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:47.862520 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsnh4\" (UniqueName: \"kubernetes.io/projected/4e7f9a93-3798-4477-9416-c96fd80f795e-kube-api-access-tsnh4\") pod \"4e7f9a93-3798-4477-9416-c96fd80f795e\" (UID: \"4e7f9a93-3798-4477-9416-c96fd80f795e\") " Jul 08 18:13:47.862548 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:47.862551 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e7f9a93-3798-4477-9416-c96fd80f795e-webhook-cert\") pod \"4e7f9a93-3798-4477-9416-c96fd80f795e\" (UID: \"4e7f9a93-3798-4477-9416-c96fd80f795e\") " Jul 08 18:13:47.864692 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:47.864669 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e7f9a93-3798-4477-9416-c96fd80f795e-kube-api-access-tsnh4" (OuterVolumeSpecName: "kube-api-access-tsnh4") pod "4e7f9a93-3798-4477-9416-c96fd80f795e" (UID: "4e7f9a93-3798-4477-9416-c96fd80f795e"). InnerVolumeSpecName "kube-api-access-tsnh4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:13:47.864783 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:47.864687 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e7f9a93-3798-4477-9416-c96fd80f795e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4e7f9a93-3798-4477-9416-c96fd80f795e" (UID: "4e7f9a93-3798-4477-9416-c96fd80f795e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:13:47.963830 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:47.963806 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsnh4\" (UniqueName: \"kubernetes.io/projected/4e7f9a93-3798-4477-9416-c96fd80f795e-kube-api-access-tsnh4\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:13:47.963830 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:47.963828 2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e7f9a93-3798-4477-9416-c96fd80f795e-webhook-cert\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:13:48.130202 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:48.130171 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-867d5bdd4f-8qpww"] Jul 08 18:13:48.134787 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:48.134763 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-867d5bdd4f-8qpww"] Jul 08 18:13:48.271307 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:13:48.271277 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e7f9a93-3798-4477-9416-c96fd80f795e" path="/var/lib/kubelet/pods/4e7f9a93-3798-4477-9416-c96fd80f795e/volumes" Jul 08 18:14:08.019913 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.019880 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-58b8b87c5b-tgq99"] Jul 08 18:14:08.020339 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.020235 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e7f9a93-3798-4477-9416-c96fd80f795e" containerName="manager" Jul 08 18:14:08.020339 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.020248 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e7f9a93-3798-4477-9416-c96fd80f795e" containerName="manager" Jul 08 18:14:08.020339 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.020297 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e7f9a93-3798-4477-9416-c96fd80f795e" containerName="manager" Jul 08 18:14:08.023404 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.023388 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-tgq99" Jul 08 18:14:08.027699 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.027654 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 08 18:14:08.027699 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.027662 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 18:14:08.027884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.027664 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 18:14:08.027884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.027792 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-m6n45\"" Jul 08 18:14:08.044093 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.044071 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-58b8b87c5b-tgq99"] Jul 08 18:14:08.111898 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.111870 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8w6n\" (UniqueName: \"kubernetes.io/projected/ed048aac-6728-4e35-88c7-7b91be8f0108-kube-api-access-v8w6n\") pod \"maas-api-58b8b87c5b-tgq99\" (UID: \"ed048aac-6728-4e35-88c7-7b91be8f0108\") " pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-tgq99" Jul 08 18:14:08.112041 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.111907 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed048aac-6728-4e35-88c7-7b91be8f0108-maas-api-tls\") pod \"maas-api-58b8b87c5b-tgq99\" (UID: \"ed048aac-6728-4e35-88c7-7b91be8f0108\") " pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-tgq99" Jul 08 18:14:08.112041 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.111927 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed048aac-6728-4e35-88c7-7b91be8f0108-openshift-service-ca\") pod \"maas-api-58b8b87c5b-tgq99\" (UID: \"ed048aac-6728-4e35-88c7-7b91be8f0108\") " pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-tgq99" Jul 08 18:14:08.212844 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.212810 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed048aac-6728-4e35-88c7-7b91be8f0108-maas-api-tls\") pod \"maas-api-58b8b87c5b-tgq99\" (UID: \"ed048aac-6728-4e35-88c7-7b91be8f0108\") " pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-tgq99" Jul 08 18:14:08.212844 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.212845 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed048aac-6728-4e35-88c7-7b91be8f0108-openshift-service-ca\") pod \"maas-api-58b8b87c5b-tgq99\" (UID: \"ed048aac-6728-4e35-88c7-7b91be8f0108\") " pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-tgq99" Jul 08 18:14:08.212987 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.212896 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8w6n\" (UniqueName: \"kubernetes.io/projected/ed048aac-6728-4e35-88c7-7b91be8f0108-kube-api-access-v8w6n\") pod \"maas-api-58b8b87c5b-tgq99\" (UID: \"ed048aac-6728-4e35-88c7-7b91be8f0108\") " pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-tgq99" Jul 08 18:14:08.213584 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.213567 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed048aac-6728-4e35-88c7-7b91be8f0108-openshift-service-ca\") pod \"maas-api-58b8b87c5b-tgq99\" (UID: \"ed048aac-6728-4e35-88c7-7b91be8f0108\") " pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-tgq99" Jul 08 18:14:08.215630 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.215608 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed048aac-6728-4e35-88c7-7b91be8f0108-maas-api-tls\") pod \"maas-api-58b8b87c5b-tgq99\" (UID: \"ed048aac-6728-4e35-88c7-7b91be8f0108\") " pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-tgq99" Jul 08 18:14:08.225625 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.225598 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8w6n\" (UniqueName: \"kubernetes.io/projected/ed048aac-6728-4e35-88c7-7b91be8f0108-kube-api-access-v8w6n\") pod \"maas-api-58b8b87c5b-tgq99\" (UID: \"ed048aac-6728-4e35-88c7-7b91be8f0108\") " pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-tgq99" Jul 08 18:14:08.333481 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.333428 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-tgq99" Jul 08 18:14:08.482454 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.482425 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-58b8b87c5b-tgq99"] Jul 08 18:14:08.486056 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:14:08.486003 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded048aac_6728_4e35_88c7_7b91be8f0108.slice/crio-a776bda91b86c91338abd27cb375cfd51c6253516b74eed6c084b13bcdf46f5e WatchSource:0}: Error finding container a776bda91b86c91338abd27cb375cfd51c6253516b74eed6c084b13bcdf46f5e: Status 404 returned error can't find the container with id a776bda91b86c91338abd27cb375cfd51c6253516b74eed6c084b13bcdf46f5e Jul 08 18:14:08.856594 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.856562 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-jwwgx"] Jul 08 18:14:08.861268 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.861246 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-jwwgx" Jul 08 18:14:08.867725 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.867707 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-qphj5\"" Jul 08 18:14:08.880564 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.880539 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 08 18:14:08.889886 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.889867 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-jwwgx"] Jul 08 18:14:08.908637 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.908605 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-tgq99" event={"ID":"ed048aac-6728-4e35-88c7-7b91be8f0108","Type":"ContainerStarted","Data":"a776bda91b86c91338abd27cb375cfd51c6253516b74eed6c084b13bcdf46f5e"} Jul 08 18:14:08.918268 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.918247 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnhpk\" (UniqueName: \"kubernetes.io/projected/5e253283-cd24-4803-a8a4-61066306d338-kube-api-access-lnhpk\") pod \"payload-processing-58f86c7798-jwwgx\" (UID: \"5e253283-cd24-4803-a8a4-61066306d338\") " pod="openshift-ingress/payload-processing-58f86c7798-jwwgx" Jul 08 18:14:08.918376 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:08.918277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e253283-cd24-4803-a8a4-61066306d338-plugins-config-volume\") pod \"payload-processing-58f86c7798-jwwgx\" (UID: \"5e253283-cd24-4803-a8a4-61066306d338\") " pod="openshift-ingress/payload-processing-58f86c7798-jwwgx" Jul 08 18:14:09.019663 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:09.019593 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnhpk\" (UniqueName: \"kubernetes.io/projected/5e253283-cd24-4803-a8a4-61066306d338-kube-api-access-lnhpk\") pod \"payload-processing-58f86c7798-jwwgx\" (UID: \"5e253283-cd24-4803-a8a4-61066306d338\") " pod="openshift-ingress/payload-processing-58f86c7798-jwwgx" Jul 08 18:14:09.019663 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:09.019621 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e253283-cd24-4803-a8a4-61066306d338-plugins-config-volume\") pod \"payload-processing-58f86c7798-jwwgx\" (UID: \"5e253283-cd24-4803-a8a4-61066306d338\") " pod="openshift-ingress/payload-processing-58f86c7798-jwwgx" Jul 08 18:14:09.020579 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:09.020511 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e253283-cd24-4803-a8a4-61066306d338-plugins-config-volume\") pod \"payload-processing-58f86c7798-jwwgx\" (UID: \"5e253283-cd24-4803-a8a4-61066306d338\") " pod="openshift-ingress/payload-processing-58f86c7798-jwwgx" Jul 08 18:14:09.032306 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:09.032284 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnhpk\" (UniqueName: \"kubernetes.io/projected/5e253283-cd24-4803-a8a4-61066306d338-kube-api-access-lnhpk\") pod \"payload-processing-58f86c7798-jwwgx\" (UID: \"5e253283-cd24-4803-a8a4-61066306d338\") " pod="openshift-ingress/payload-processing-58f86c7798-jwwgx" Jul 08 18:14:09.173329 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:09.173306 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-jwwgx" Jul 08 18:14:09.355899 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:09.355874 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-jwwgx"] Jul 08 18:14:09.357982 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:14:09.357952 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e253283_cd24_4803_a8a4_61066306d338.slice/crio-7ec246177315605188fbc79986da4a100b2030a31070758a78d4e4ed25693acd WatchSource:0}: Error finding container 7ec246177315605188fbc79986da4a100b2030a31070758a78d4e4ed25693acd: Status 404 returned error can't find the container with id 7ec246177315605188fbc79986da4a100b2030a31070758a78d4e4ed25693acd Jul 08 18:14:09.916191 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:09.916143 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-jwwgx" event={"ID":"5e253283-cd24-4803-a8a4-61066306d338","Type":"ContainerStarted","Data":"7ec246177315605188fbc79986da4a100b2030a31070758a78d4e4ed25693acd"} Jul 08 18:14:10.923951 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:10.923918 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-tgq99" event={"ID":"ed048aac-6728-4e35-88c7-7b91be8f0108","Type":"ContainerStarted","Data":"fa89b08cff4228c36ab889a1b1675ff30b02c4b341cd1af3e0060834b6e06c01"} Jul 08 18:14:10.924373 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:10.924131 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-tgq99" Jul 08 18:14:10.952509 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:10.952459 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-tgq99" podStartSLOduration=1.820438079 podStartE2EDuration="3.952442848s" totalImagesPullingTime="2.132004769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:14:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:14:10.949437249 +0000 UTC m=+585.193335436" watchObservedRunningTime="2026-07-08 18:14:10.952442848 +0000 UTC m=+585.196341015" Jul 08 18:14:11.930097 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:11.930054 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-jwwgx" event={"ID":"5e253283-cd24-4803-a8a4-61066306d338","Type":"ContainerStarted","Data":"a79c1cc501cbd92019002cd101a2fab3bb13d743619f3a77b3d1770ce88c1717"} Jul 08 18:14:11.930513 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:11.930276 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-jwwgx" Jul 08 18:14:11.957741 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:11.957699 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-jwwgx" podStartSLOduration=2.336043978 podStartE2EDuration="3.957685757s" totalImagesPullingTime="1.621641779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:14:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:14:11.954957571 +0000 UTC m=+586.198855736" watchObservedRunningTime="2026-07-08 18:14:11.957685757 +0000 UTC m=+586.201583928" Jul 08 18:14:16.936333 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:16.936291 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-tgq99" Jul 08 18:14:22.937628 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:22.937589 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-jwwgx" Jul 08 18:14:26.189684 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:26.189651 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9ftw_6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe/ovn-acl-logging/0.log" Jul 08 18:14:26.190202 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:26.189860 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9ftw_6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe/ovn-acl-logging/0.log" Jul 08 18:14:51.556060 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.555944 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5"] Jul 08 18:14:51.559582 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.559566 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:14:51.563381 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.563360 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-l6gpw\"" Jul 08 18:14:51.563381 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.563371 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 08 18:14:51.563559 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.563444 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 18:14:51.563852 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.563837 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 18:14:51.576213 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.576192 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5"] Jul 08 18:14:51.744738 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.744707 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2479932-e180-4281-aa62-077f70c27d40-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rfrr5\" (UID: \"a2479932-e180-4281-aa62-077f70c27d40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:14:51.744868 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.744749 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2479932-e180-4281-aa62-077f70c27d40-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rfrr5\" (UID: \"a2479932-e180-4281-aa62-077f70c27d40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:14:51.744868 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.744767 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2479932-e180-4281-aa62-077f70c27d40-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rfrr5\" (UID: \"a2479932-e180-4281-aa62-077f70c27d40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:14:51.744868 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.744847 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2479932-e180-4281-aa62-077f70c27d40-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rfrr5\" (UID: \"a2479932-e180-4281-aa62-077f70c27d40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:14:51.744972 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.744906 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2479932-e180-4281-aa62-077f70c27d40-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rfrr5\" (UID: \"a2479932-e180-4281-aa62-077f70c27d40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:14:51.744972 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.744947 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsjfj\" (UniqueName: \"kubernetes.io/projected/a2479932-e180-4281-aa62-077f70c27d40-kube-api-access-nsjfj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rfrr5\" (UID: \"a2479932-e180-4281-aa62-077f70c27d40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:14:51.845708 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.845649 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2479932-e180-4281-aa62-077f70c27d40-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rfrr5\" (UID: \"a2479932-e180-4281-aa62-077f70c27d40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:14:51.845708 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.845690 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsjfj\" (UniqueName: \"kubernetes.io/projected/a2479932-e180-4281-aa62-077f70c27d40-kube-api-access-nsjfj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rfrr5\" (UID: \"a2479932-e180-4281-aa62-077f70c27d40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:14:51.845891 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.845717 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2479932-e180-4281-aa62-077f70c27d40-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rfrr5\" (UID: \"a2479932-e180-4281-aa62-077f70c27d40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:14:51.845891 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.845733 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2479932-e180-4281-aa62-077f70c27d40-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rfrr5\" (UID: \"a2479932-e180-4281-aa62-077f70c27d40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:14:51.845891 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.845747 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2479932-e180-4281-aa62-077f70c27d40-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rfrr5\" (UID: \"a2479932-e180-4281-aa62-077f70c27d40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:14:51.845891 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.845790 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2479932-e180-4281-aa62-077f70c27d40-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rfrr5\" (UID: \"a2479932-e180-4281-aa62-077f70c27d40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:14:51.846196 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.846159 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2479932-e180-4281-aa62-077f70c27d40-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rfrr5\" (UID: \"a2479932-e180-4281-aa62-077f70c27d40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:14:51.846332 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.846258 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2479932-e180-4281-aa62-077f70c27d40-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rfrr5\" (UID: \"a2479932-e180-4281-aa62-077f70c27d40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:14:51.846332 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.846306 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2479932-e180-4281-aa62-077f70c27d40-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rfrr5\" (UID: \"a2479932-e180-4281-aa62-077f70c27d40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:14:51.848304 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.848283 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2479932-e180-4281-aa62-077f70c27d40-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rfrr5\" (UID: \"a2479932-e180-4281-aa62-077f70c27d40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:14:51.848478 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.848465 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2479932-e180-4281-aa62-077f70c27d40-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rfrr5\" (UID: \"a2479932-e180-4281-aa62-077f70c27d40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:14:51.858131 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.858108 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsjfj\" (UniqueName: \"kubernetes.io/projected/a2479932-e180-4281-aa62-077f70c27d40-kube-api-access-nsjfj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rfrr5\" (UID: \"a2479932-e180-4281-aa62-077f70c27d40\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:14:51.870015 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:51.869999 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:14:52.017128 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:52.017100 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5"] Jul 08 18:14:52.019106 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:14:52.019073 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2479932_e180_4281_aa62_077f70c27d40.slice/crio-0cc053e49226db5693ed927016b0330cb4d7abca4f4d5a829dd2974a1d43074f WatchSource:0}: Error finding container 0cc053e49226db5693ed927016b0330cb4d7abca4f4d5a829dd2974a1d43074f: Status 404 returned error can't find the container with id 0cc053e49226db5693ed927016b0330cb4d7abca4f4d5a829dd2974a1d43074f Jul 08 18:14:52.020575 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:52.020552 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:14:52.134541 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:52.134479 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" event={"ID":"a2479932-e180-4281-aa62-077f70c27d40","Type":"ContainerStarted","Data":"0cc053e49226db5693ed927016b0330cb4d7abca4f4d5a829dd2974a1d43074f"} Jul 08 18:14:53.140611 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:53.140581 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" event={"ID":"a2479932-e180-4281-aa62-077f70c27d40","Type":"ContainerStarted","Data":"b38e684ab083e9464c0e14003baf7b906f1d7649d73af21c7bdfdcb09dc17c0e"} Jul 08 18:14:53.167852 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:14:53.167801 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" podStartSLOduration=1.117437663 podStartE2EDuration="2.1677813s" totalImagesPullingTime="1.050343637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:14:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:14:53.167690529 +0000 UTC m=+627.411588695" watchObservedRunningTime="2026-07-08 18:14:53.1677813 +0000 UTC m=+627.411679469" Jul 08 18:15:01.870199 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:15:01.870167 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:15:01.870641 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:15:01.870231 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:15:01.882426 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:15:01.882400 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:15:02.197176 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:15:02.197151 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rfrr5" Jul 08 18:19:26.219854 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:19:26.219785 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9ftw_6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe/ovn-acl-logging/0.log" Jul 08 18:19:26.223250 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:19:26.223229 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9ftw_6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe/ovn-acl-logging/0.log" Jul 08 18:22:22.052533 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:22:22.052459 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7"] Jul 08 18:22:22.054884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:22:22.052644 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7" podUID="5cf83148-673f-4d3e-b8c6-88264728f7c8" containerName="manager" containerID="cri-o://aee6bdf5e31c40241f3a268b3f763f3f7fa5976575cb7cff1b7257996e2c982d" gracePeriod=10 Jul 08 18:22:24.387731 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:22:24.387704 2574 generic.go:356] "Generic (PLEG): container finished" podID="5cf83148-673f-4d3e-b8c6-88264728f7c8" containerID="aee6bdf5e31c40241f3a268b3f763f3f7fa5976575cb7cff1b7257996e2c982d" exitCode=0 Jul 08 18:22:24.388061 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:22:24.387758 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7" event={"ID":"5cf83148-673f-4d3e-b8c6-88264728f7c8","Type":"ContainerDied","Data":"aee6bdf5e31c40241f3a268b3f763f3f7fa5976575cb7cff1b7257996e2c982d"} Jul 08 18:22:24.499391 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:22:24.499370 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7" Jul 08 18:22:24.586758 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:22:24.586698 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v85f\" (UniqueName: \"kubernetes.io/projected/5cf83148-673f-4d3e-b8c6-88264728f7c8-kube-api-access-4v85f\") pod \"5cf83148-673f-4d3e-b8c6-88264728f7c8\" (UID: \"5cf83148-673f-4d3e-b8c6-88264728f7c8\") " Jul 08 18:22:24.586758 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:22:24.586739 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cf83148-673f-4d3e-b8c6-88264728f7c8-extensions-socket-volume\") pod \"5cf83148-673f-4d3e-b8c6-88264728f7c8\" (UID: \"5cf83148-673f-4d3e-b8c6-88264728f7c8\") " Jul 08 18:22:24.587130 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:22:24.587103 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cf83148-673f-4d3e-b8c6-88264728f7c8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5cf83148-673f-4d3e-b8c6-88264728f7c8" (UID: "5cf83148-673f-4d3e-b8c6-88264728f7c8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:22:24.588793 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:22:24.588761 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cf83148-673f-4d3e-b8c6-88264728f7c8-kube-api-access-4v85f" (OuterVolumeSpecName: "kube-api-access-4v85f") pod "5cf83148-673f-4d3e-b8c6-88264728f7c8" (UID: "5cf83148-673f-4d3e-b8c6-88264728f7c8"). InnerVolumeSpecName "kube-api-access-4v85f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:22:24.687320 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:22:24.687285 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v85f\" (UniqueName: \"kubernetes.io/projected/5cf83148-673f-4d3e-b8c6-88264728f7c8-kube-api-access-4v85f\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:22:24.687320 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:22:24.687318 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cf83148-673f-4d3e-b8c6-88264728f7c8-extensions-socket-volume\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:22:25.401862 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:22:25.401835 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7" Jul 08 18:22:25.401862 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:22:25.401842 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7" event={"ID":"5cf83148-673f-4d3e-b8c6-88264728f7c8","Type":"ContainerDied","Data":"c7ceb83dd0475929a2d0003f36e8e238e5593a9bac27d1c37819515eb14ff7ae"} Jul 08 18:22:25.402342 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:22:25.401924 2574 scope.go:117] "RemoveContainer" containerID="aee6bdf5e31c40241f3a268b3f763f3f7fa5976575cb7cff1b7257996e2c982d" Jul 08 18:22:25.428617 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:22:25.428591 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7"] Jul 08 18:22:25.433523 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:22:25.433501 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wz2p7"] Jul 08 18:22:26.270738 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:22:26.270711 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cf83148-673f-4d3e-b8c6-88264728f7c8" path="/var/lib/kubelet/pods/5cf83148-673f-4d3e-b8c6-88264728f7c8/volumes" Jul 08 18:23:23.205656 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:23.205620 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztzl"] Jul 08 18:23:23.206145 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:23.205925 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cf83148-673f-4d3e-b8c6-88264728f7c8" containerName="manager" Jul 08 18:23:23.206145 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:23.205937 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cf83148-673f-4d3e-b8c6-88264728f7c8" containerName="manager" Jul 08 18:23:23.206145 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:23.206003 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cf83148-673f-4d3e-b8c6-88264728f7c8" containerName="manager" Jul 08 18:23:23.208819 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:23.208800 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztzl" Jul 08 18:23:23.212349 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:23.212327 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 18:23:23.212462 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:23.212361 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 18:23:23.212533 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:23.212481 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gxlrs\"" Jul 08 18:23:23.222330 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:23.222309 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztzl"] Jul 08 18:23:23.322478 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:23.322455 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt7jh\" (UniqueName: \"kubernetes.io/projected/e620b391-1135-4353-bfa5-bb6e783c7d8f-kube-api-access-nt7jh\") pod \"kuadrant-operator-controller-manager-86878c769f-9ztzl\" (UID: \"e620b391-1135-4353-bfa5-bb6e783c7d8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztzl" Jul 08 18:23:23.322583 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:23.322508 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e620b391-1135-4353-bfa5-bb6e783c7d8f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9ztzl\" (UID: \"e620b391-1135-4353-bfa5-bb6e783c7d8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztzl" Jul 08 18:23:23.423748 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:23.423718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e620b391-1135-4353-bfa5-bb6e783c7d8f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9ztzl\" (UID: \"e620b391-1135-4353-bfa5-bb6e783c7d8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztzl" Jul 08 18:23:23.423882 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:23.423786 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt7jh\" (UniqueName: \"kubernetes.io/projected/e620b391-1135-4353-bfa5-bb6e783c7d8f-kube-api-access-nt7jh\") pod \"kuadrant-operator-controller-manager-86878c769f-9ztzl\" (UID: \"e620b391-1135-4353-bfa5-bb6e783c7d8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztzl" Jul 08 18:23:23.424157 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:23.424138 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e620b391-1135-4353-bfa5-bb6e783c7d8f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9ztzl\" (UID: \"e620b391-1135-4353-bfa5-bb6e783c7d8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztzl" Jul 08 18:23:23.432905 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:23.432877 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt7jh\" (UniqueName: \"kubernetes.io/projected/e620b391-1135-4353-bfa5-bb6e783c7d8f-kube-api-access-nt7jh\") pod \"kuadrant-operator-controller-manager-86878c769f-9ztzl\" (UID: \"e620b391-1135-4353-bfa5-bb6e783c7d8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztzl" Jul 08 18:23:23.519229 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:23.519182 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztzl" Jul 08 18:23:23.662372 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:23.662348 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztzl"] Jul 08 18:23:23.664790 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:23:23.664765 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode620b391_1135_4353_bfa5_bb6e783c7d8f.slice/crio-32e13e709c675969a2753add65323f3796cb8991c7f9d9a80cbe4cdc637ba86b WatchSource:0}: Error finding container 32e13e709c675969a2753add65323f3796cb8991c7f9d9a80cbe4cdc637ba86b: Status 404 returned error can't find the container with id 32e13e709c675969a2753add65323f3796cb8991c7f9d9a80cbe4cdc637ba86b Jul 08 18:23:23.690561 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:23.690530 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztzl" event={"ID":"e620b391-1135-4353-bfa5-bb6e783c7d8f","Type":"ContainerStarted","Data":"32e13e709c675969a2753add65323f3796cb8991c7f9d9a80cbe4cdc637ba86b"} Jul 08 18:23:24.697761 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:24.697727 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztzl" event={"ID":"e620b391-1135-4353-bfa5-bb6e783c7d8f","Type":"ContainerStarted","Data":"1bb9a1c7d4edb9c9b0208c552b867e714a78b4b061f2cd8befdd642483488e2b"} Jul 08 18:23:24.698224 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:24.697813 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztzl" Jul 08 18:23:35.706780 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:35.706746 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztzl" Jul 08 18:23:35.733487 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:23:35.733432 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztzl" podStartSLOduration=12.733417039 podStartE2EDuration="12.733417039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:23:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:23:24.728689686 +0000 UTC m=+1138.972587861" watchObservedRunningTime="2026-07-08 18:23:35.733417039 +0000 UTC m=+1149.977315205" Jul 08 18:24:26.251062 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:24:26.250975 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9ftw_6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe/ovn-acl-logging/0.log" Jul 08 18:24:26.254851 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:24:26.254830 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9ftw_6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe/ovn-acl-logging/0.log" Jul 08 18:29:26.282870 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:26.282838 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9ftw_6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe/ovn-acl-logging/0.log" Jul 08 18:29:26.286710 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:26.286688 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9ftw_6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe/ovn-acl-logging/0.log" Jul 08 18:29:37.002714 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:37.002686 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc"] Jul 08 18:29:37.005744 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:37.005730 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" Jul 08 18:29:37.008707 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:37.008686 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ef85937c-serving-cert\"" Jul 08 18:29:37.015818 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:37.015797 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc"] Jul 08 18:29:37.040598 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:37.040571 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjr7g\" (UniqueName: \"kubernetes.io/projected/295b244c-a53e-4102-be50-82797adfb5bc-kube-api-access-hjr7g\") pod \"maas-api-e2e-ait-ef85937c-6f85c9987-njkpc\" (UID: \"295b244c-a53e-4102-be50-82797adfb5bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" Jul 08 18:29:37.040704 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:37.040626 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/295b244c-a53e-4102-be50-82797adfb5bc-maas-api-tls\") pod \"maas-api-e2e-ait-ef85937c-6f85c9987-njkpc\" (UID: \"295b244c-a53e-4102-be50-82797adfb5bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" Jul 08 18:29:37.040759 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:37.040720 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/295b244c-a53e-4102-be50-82797adfb5bc-openshift-service-ca\") pod \"maas-api-e2e-ait-ef85937c-6f85c9987-njkpc\" (UID: \"295b244c-a53e-4102-be50-82797adfb5bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" Jul 08 18:29:37.141602 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:37.141573 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/295b244c-a53e-4102-be50-82797adfb5bc-openshift-service-ca\") pod \"maas-api-e2e-ait-ef85937c-6f85c9987-njkpc\" (UID: \"295b244c-a53e-4102-be50-82797adfb5bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" Jul 08 18:29:37.141716 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:37.141616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjr7g\" (UniqueName: \"kubernetes.io/projected/295b244c-a53e-4102-be50-82797adfb5bc-kube-api-access-hjr7g\") pod \"maas-api-e2e-ait-ef85937c-6f85c9987-njkpc\" (UID: \"295b244c-a53e-4102-be50-82797adfb5bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" Jul 08 18:29:37.141770 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:37.141725 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/295b244c-a53e-4102-be50-82797adfb5bc-maas-api-tls\") pod \"maas-api-e2e-ait-ef85937c-6f85c9987-njkpc\" (UID: \"295b244c-a53e-4102-be50-82797adfb5bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" Jul 08 18:29:37.142261 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:37.142231 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/295b244c-a53e-4102-be50-82797adfb5bc-openshift-service-ca\") pod \"maas-api-e2e-ait-ef85937c-6f85c9987-njkpc\" (UID: \"295b244c-a53e-4102-be50-82797adfb5bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" Jul 08 18:29:37.144222 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:37.144204 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/295b244c-a53e-4102-be50-82797adfb5bc-maas-api-tls\") pod \"maas-api-e2e-ait-ef85937c-6f85c9987-njkpc\" (UID: \"295b244c-a53e-4102-be50-82797adfb5bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" Jul 08 18:29:37.149394 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:37.149375 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjr7g\" (UniqueName: \"kubernetes.io/projected/295b244c-a53e-4102-be50-82797adfb5bc-kube-api-access-hjr7g\") pod \"maas-api-e2e-ait-ef85937c-6f85c9987-njkpc\" (UID: \"295b244c-a53e-4102-be50-82797adfb5bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" Jul 08 18:29:37.317061 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:37.316992 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" Jul 08 18:29:37.453035 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:37.452998 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc"] Jul 08 18:29:37.454946 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:29:37.454914 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod295b244c_a53e_4102_be50_82797adfb5bc.slice/crio-63667d90ee11cfa40e02dfa5f220afcc2e45e35d7fcf524d2e0869304e9bdd95 WatchSource:0}: Error finding container 63667d90ee11cfa40e02dfa5f220afcc2e45e35d7fcf524d2e0869304e9bdd95: Status 404 returned error can't find the container with id 63667d90ee11cfa40e02dfa5f220afcc2e45e35d7fcf524d2e0869304e9bdd95 Jul 08 18:29:37.456340 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:37.456310 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:29:37.502681 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:37.502646 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" event={"ID":"295b244c-a53e-4102-be50-82797adfb5bc","Type":"ContainerStarted","Data":"63667d90ee11cfa40e02dfa5f220afcc2e45e35d7fcf524d2e0869304e9bdd95"} Jul 08 18:29:38.509691 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:38.509656 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" event={"ID":"295b244c-a53e-4102-be50-82797adfb5bc","Type":"ContainerStarted","Data":"ef189541b0d33e419ebd1df85fa563b61bf85c7ff3b8edc8680885b5db304338"} Jul 08 18:29:38.510072 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:38.509748 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" Jul 08 18:29:38.528265 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:38.528223 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" podStartSLOduration=2.042401345 podStartE2EDuration="2.52820923s" totalImagesPullingTime="485.807885ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:29:38.526578155 +0000 UTC m=+1512.770476341" watchObservedRunningTime="2026-07-08 18:29:38.52820923 +0000 UTC m=+1512.772107394" Jul 08 18:29:42.346196 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:42.346164 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc"] Jul 08 18:29:42.347003 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:42.346967 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" podUID="295b244c-a53e-4102-be50-82797adfb5bc" containerName="maas-api" containerID="cri-o://ef189541b0d33e419ebd1df85fa563b61bf85c7ff3b8edc8680885b5db304338" gracePeriod=30 Jul 08 18:29:42.353104 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:42.353077 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" Jul 08 18:29:42.533149 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:42.533124 2574 generic.go:356] "Generic (PLEG): container finished" podID="295b244c-a53e-4102-be50-82797adfb5bc" containerID="ef189541b0d33e419ebd1df85fa563b61bf85c7ff3b8edc8680885b5db304338" exitCode=0 Jul 08 18:29:42.533270 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:42.533200 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" event={"ID":"295b244c-a53e-4102-be50-82797adfb5bc","Type":"ContainerDied","Data":"ef189541b0d33e419ebd1df85fa563b61bf85c7ff3b8edc8680885b5db304338"} Jul 08 18:29:42.588545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:42.588521 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" Jul 08 18:29:42.684323 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:42.684302 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjr7g\" (UniqueName: \"kubernetes.io/projected/295b244c-a53e-4102-be50-82797adfb5bc-kube-api-access-hjr7g\") pod \"295b244c-a53e-4102-be50-82797adfb5bc\" (UID: \"295b244c-a53e-4102-be50-82797adfb5bc\") " Jul 08 18:29:42.684463 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:42.684345 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/295b244c-a53e-4102-be50-82797adfb5bc-openshift-service-ca\") pod \"295b244c-a53e-4102-be50-82797adfb5bc\" (UID: \"295b244c-a53e-4102-be50-82797adfb5bc\") " Jul 08 18:29:42.684463 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:42.684372 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/295b244c-a53e-4102-be50-82797adfb5bc-maas-api-tls\") pod \"295b244c-a53e-4102-be50-82797adfb5bc\" (UID: \"295b244c-a53e-4102-be50-82797adfb5bc\") " Jul 08 18:29:42.684681 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:42.684658 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/295b244c-a53e-4102-be50-82797adfb5bc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "295b244c-a53e-4102-be50-82797adfb5bc" (UID: "295b244c-a53e-4102-be50-82797adfb5bc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:29:42.686559 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:42.686537 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/295b244c-a53e-4102-be50-82797adfb5bc-kube-api-access-hjr7g" (OuterVolumeSpecName: "kube-api-access-hjr7g") pod "295b244c-a53e-4102-be50-82797adfb5bc" (UID: "295b244c-a53e-4102-be50-82797adfb5bc"). InnerVolumeSpecName "kube-api-access-hjr7g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:29:42.686650 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:42.686562 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/295b244c-a53e-4102-be50-82797adfb5bc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "295b244c-a53e-4102-be50-82797adfb5bc" (UID: "295b244c-a53e-4102-be50-82797adfb5bc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:29:42.785215 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:42.785195 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjr7g\" (UniqueName: \"kubernetes.io/projected/295b244c-a53e-4102-be50-82797adfb5bc-kube-api-access-hjr7g\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:29:42.785215 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:42.785214 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/295b244c-a53e-4102-be50-82797adfb5bc-openshift-service-ca\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:29:42.785333 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:42.785225 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/295b244c-a53e-4102-be50-82797adfb5bc-maas-api-tls\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:29:43.540088 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:43.540059 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" Jul 08 18:29:43.540469 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:43.540062 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc" event={"ID":"295b244c-a53e-4102-be50-82797adfb5bc","Type":"ContainerDied","Data":"63667d90ee11cfa40e02dfa5f220afcc2e45e35d7fcf524d2e0869304e9bdd95"} Jul 08 18:29:43.540469 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:43.540182 2574 scope.go:117] "RemoveContainer" containerID="ef189541b0d33e419ebd1df85fa563b61bf85c7ff3b8edc8680885b5db304338" Jul 08 18:29:43.562691 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:43.562665 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc"] Jul 08 18:29:43.568512 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:43.568489 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ef85937c-6f85c9987-njkpc"] Jul 08 18:29:44.271352 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:44.271316 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="295b244c-a53e-4102-be50-82797adfb5bc" path="/var/lib/kubelet/pods/295b244c-a53e-4102-be50-82797adfb5bc/volumes" Jul 08 18:29:50.045647 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:50.045612 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs"] Jul 08 18:29:50.046171 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:50.046120 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="295b244c-a53e-4102-be50-82797adfb5bc" containerName="maas-api" Jul 08 18:29:50.046171 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:50.046139 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="295b244c-a53e-4102-be50-82797adfb5bc" containerName="maas-api" Jul 08 18:29:50.046299 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:50.046228 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="295b244c-a53e-4102-be50-82797adfb5bc" containerName="maas-api" Jul 08 18:29:50.051223 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:50.051198 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" Jul 08 18:29:50.054071 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:50.054048 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-07d6fd50-serving-cert\"" Jul 08 18:29:50.061500 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:50.061478 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs"] Jul 08 18:29:50.139993 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:50.139962 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db786176-371b-4ea9-afb6-795785299735-openshift-service-ca\") pod \"maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs\" (UID: \"db786176-371b-4ea9-afb6-795785299735\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" Jul 08 18:29:50.140121 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:50.140092 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p927v\" (UniqueName: \"kubernetes.io/projected/db786176-371b-4ea9-afb6-795785299735-kube-api-access-p927v\") pod \"maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs\" (UID: \"db786176-371b-4ea9-afb6-795785299735\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" Jul 08 18:29:50.140237 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:50.140138 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db786176-371b-4ea9-afb6-795785299735-maas-api-tls\") pod \"maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs\" (UID: \"db786176-371b-4ea9-afb6-795785299735\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" Jul 08 18:29:50.241219 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:50.241181 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db786176-371b-4ea9-afb6-795785299735-openshift-service-ca\") pod \"maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs\" (UID: \"db786176-371b-4ea9-afb6-795785299735\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" Jul 08 18:29:50.241369 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:50.241261 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p927v\" (UniqueName: \"kubernetes.io/projected/db786176-371b-4ea9-afb6-795785299735-kube-api-access-p927v\") pod \"maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs\" (UID: \"db786176-371b-4ea9-afb6-795785299735\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" Jul 08 18:29:50.241369 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:50.241296 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db786176-371b-4ea9-afb6-795785299735-maas-api-tls\") pod \"maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs\" (UID: \"db786176-371b-4ea9-afb6-795785299735\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" Jul 08 18:29:50.241488 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:29:50.241421 2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-serving-cert: secret "maas-api-e2e-migrate-07d6fd50-serving-cert" not found Jul 08 18:29:50.241488 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:29:50.241481 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db786176-371b-4ea9-afb6-795785299735-maas-api-tls podName:db786176-371b-4ea9-afb6-795785299735 nodeName:}" failed. No retries permitted until 2026-07-08 18:29:50.741464977 +0000 UTC m=+1524.985363120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/db786176-371b-4ea9-afb6-795785299735-maas-api-tls") pod "maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" (UID: "db786176-371b-4ea9-afb6-795785299735") : secret "maas-api-e2e-migrate-07d6fd50-serving-cert" not found Jul 08 18:29:50.241873 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:50.241848 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db786176-371b-4ea9-afb6-795785299735-openshift-service-ca\") pod \"maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs\" (UID: \"db786176-371b-4ea9-afb6-795785299735\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" Jul 08 18:29:50.250227 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:50.250207 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p927v\" (UniqueName: \"kubernetes.io/projected/db786176-371b-4ea9-afb6-795785299735-kube-api-access-p927v\") pod \"maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs\" (UID: \"db786176-371b-4ea9-afb6-795785299735\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" Jul 08 18:29:50.744290 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:50.744251 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db786176-371b-4ea9-afb6-795785299735-maas-api-tls\") pod \"maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs\" (UID: \"db786176-371b-4ea9-afb6-795785299735\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" Jul 08 18:29:50.746747 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:50.746716 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db786176-371b-4ea9-afb6-795785299735-maas-api-tls\") pod \"maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs\" (UID: \"db786176-371b-4ea9-afb6-795785299735\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" Jul 08 18:29:50.965006 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:50.964975 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" Jul 08 18:29:51.101547 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:51.101513 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs"] Jul 08 18:29:51.107061 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:29:51.106997 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb786176_371b_4ea9_afb6_795785299735.slice/crio-205f0bbec21f0233b04377aca1a5143825af4a131264fbf24795ea3630a5a862 WatchSource:0}: Error finding container 205f0bbec21f0233b04377aca1a5143825af4a131264fbf24795ea3630a5a862: Status 404 returned error can't find the container with id 205f0bbec21f0233b04377aca1a5143825af4a131264fbf24795ea3630a5a862 Jul 08 18:29:51.581520 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:51.581489 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" event={"ID":"db786176-371b-4ea9-afb6-795785299735","Type":"ContainerStarted","Data":"205f0bbec21f0233b04377aca1a5143825af4a131264fbf24795ea3630a5a862"} Jul 08 18:29:52.587338 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:52.587297 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" event={"ID":"db786176-371b-4ea9-afb6-795785299735","Type":"ContainerStarted","Data":"a94b47e960b380b0a7881c9473e594aa9546a8c694e1663847d794e95c991b67"} Jul 08 18:29:52.587691 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:52.587372 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" Jul 08 18:29:52.606622 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:52.606573 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" podStartSLOduration=1.660389453 podStartE2EDuration="2.606559161s" totalImagesPullingTime="946.169708ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:29:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:29:52.605782547 +0000 UTC m=+1526.849680742" watchObservedRunningTime="2026-07-08 18:29:52.606559161 +0000 UTC m=+1526.850457349" Jul 08 18:29:54.931095 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:54.931063 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs"] Jul 08 18:29:54.931504 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:54.931272 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" podUID="db786176-371b-4ea9-afb6-795785299735" containerName="maas-api" containerID="cri-o://a94b47e960b380b0a7881c9473e594aa9546a8c694e1663847d794e95c991b67" gracePeriod=30 Jul 08 18:29:55.175358 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:55.175333 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" Jul 08 18:29:55.274838 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:55.274773 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db786176-371b-4ea9-afb6-795785299735-maas-api-tls\") pod \"db786176-371b-4ea9-afb6-795785299735\" (UID: \"db786176-371b-4ea9-afb6-795785299735\") " Jul 08 18:29:55.274977 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:55.274848 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p927v\" (UniqueName: \"kubernetes.io/projected/db786176-371b-4ea9-afb6-795785299735-kube-api-access-p927v\") pod \"db786176-371b-4ea9-afb6-795785299735\" (UID: \"db786176-371b-4ea9-afb6-795785299735\") " Jul 08 18:29:55.274977 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:55.274897 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db786176-371b-4ea9-afb6-795785299735-openshift-service-ca\") pod \"db786176-371b-4ea9-afb6-795785299735\" (UID: \"db786176-371b-4ea9-afb6-795785299735\") " Jul 08 18:29:55.275297 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:55.275269 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db786176-371b-4ea9-afb6-795785299735-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "db786176-371b-4ea9-afb6-795785299735" (UID: "db786176-371b-4ea9-afb6-795785299735"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:29:55.276884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:55.276866 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db786176-371b-4ea9-afb6-795785299735-kube-api-access-p927v" (OuterVolumeSpecName: "kube-api-access-p927v") pod "db786176-371b-4ea9-afb6-795785299735" (UID: "db786176-371b-4ea9-afb6-795785299735"). InnerVolumeSpecName "kube-api-access-p927v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:29:55.276964 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:55.276950 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db786176-371b-4ea9-afb6-795785299735-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "db786176-371b-4ea9-afb6-795785299735" (UID: "db786176-371b-4ea9-afb6-795785299735"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:29:55.376336 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:55.376311 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db786176-371b-4ea9-afb6-795785299735-maas-api-tls\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:29:55.376336 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:55.376334 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p927v\" (UniqueName: \"kubernetes.io/projected/db786176-371b-4ea9-afb6-795785299735-kube-api-access-p927v\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:29:55.376459 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:55.376343 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db786176-371b-4ea9-afb6-795785299735-openshift-service-ca\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:29:55.604223 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:55.604150 2574 generic.go:356] "Generic (PLEG): container finished" podID="db786176-371b-4ea9-afb6-795785299735" containerID="a94b47e960b380b0a7881c9473e594aa9546a8c694e1663847d794e95c991b67" exitCode=0 Jul 08 18:29:55.604223 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:55.604196 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" Jul 08 18:29:55.604366 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:55.604245 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" event={"ID":"db786176-371b-4ea9-afb6-795785299735","Type":"ContainerDied","Data":"a94b47e960b380b0a7881c9473e594aa9546a8c694e1663847d794e95c991b67"} Jul 08 18:29:55.604366 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:55.604291 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs" event={"ID":"db786176-371b-4ea9-afb6-795785299735","Type":"ContainerDied","Data":"205f0bbec21f0233b04377aca1a5143825af4a131264fbf24795ea3630a5a862"} Jul 08 18:29:55.604366 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:55.604314 2574 scope.go:117] "RemoveContainer" containerID="a94b47e960b380b0a7881c9473e594aa9546a8c694e1663847d794e95c991b67" Jul 08 18:29:55.613111 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:55.613097 2574 scope.go:117] "RemoveContainer" containerID="a94b47e960b380b0a7881c9473e594aa9546a8c694e1663847d794e95c991b67" Jul 08 18:29:55.613337 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:29:55.613319 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a94b47e960b380b0a7881c9473e594aa9546a8c694e1663847d794e95c991b67\": container with ID starting with a94b47e960b380b0a7881c9473e594aa9546a8c694e1663847d794e95c991b67 not found: ID does not exist" containerID="a94b47e960b380b0a7881c9473e594aa9546a8c694e1663847d794e95c991b67" Jul 08 18:29:55.613381 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:55.613344 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a94b47e960b380b0a7881c9473e594aa9546a8c694e1663847d794e95c991b67"} err="failed to get container status \"a94b47e960b380b0a7881c9473e594aa9546a8c694e1663847d794e95c991b67\": rpc error: code = NotFound desc = could not find container \"a94b47e960b380b0a7881c9473e594aa9546a8c694e1663847d794e95c991b67\": container with ID starting with a94b47e960b380b0a7881c9473e594aa9546a8c694e1663847d794e95c991b67 not found: ID does not exist" Jul 08 18:29:55.627971 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:55.627941 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs"] Jul 08 18:29:55.630451 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:55.630429 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-07d6fd50-5cbcb8cf66-n5gcs"] Jul 08 18:29:56.271138 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:29:56.271109 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db786176-371b-4ea9-afb6-795785299735" path="/var/lib/kubelet/pods/db786176-371b-4ea9-afb6-795785299735/volumes" Jul 08 18:30:00.131788 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:00.131755 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725590-dqncd"] Jul 08 18:30:00.132147 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:00.132119 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db786176-371b-4ea9-afb6-795785299735" containerName="maas-api" Jul 08 18:30:00.132147 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:00.132131 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="db786176-371b-4ea9-afb6-795785299735" containerName="maas-api" Jul 08 18:30:00.132224 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:00.132193 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="db786176-371b-4ea9-afb6-795785299735" containerName="maas-api" Jul 08 18:30:00.135250 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:00.135235 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-dqncd" Jul 08 18:30:00.142073 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:00.142046 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725590-dqncd"] Jul 08 18:30:00.217392 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:00.217360 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d58d7\" (UniqueName: \"kubernetes.io/projected/b8231472-76af-4991-931d-d749b9dac434-kube-api-access-d58d7\") pod \"maas-api-key-cleanup-29725590-dqncd\" (UID: \"b8231472-76af-4991-931d-d749b9dac434\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-dqncd" Jul 08 18:30:00.318672 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:00.318647 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d58d7\" (UniqueName: \"kubernetes.io/projected/b8231472-76af-4991-931d-d749b9dac434-kube-api-access-d58d7\") pod \"maas-api-key-cleanup-29725590-dqncd\" (UID: \"b8231472-76af-4991-931d-d749b9dac434\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-dqncd" Jul 08 18:30:00.327750 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:00.327723 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d58d7\" (UniqueName: \"kubernetes.io/projected/b8231472-76af-4991-931d-d749b9dac434-kube-api-access-d58d7\") pod \"maas-api-key-cleanup-29725590-dqncd\" (UID: \"b8231472-76af-4991-931d-d749b9dac434\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-dqncd" Jul 08 18:30:00.446452 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:00.446432 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-dqncd" Jul 08 18:30:00.589751 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:00.589718 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725590-dqncd"] Jul 08 18:30:00.590743 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:30:00.590718 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8231472_76af_4991_931d_d749b9dac434.slice/crio-f8ac5dc47eeb1bd6216ea60a9b1a2a12bb078d66d19662a7a3c18ab21eaa8bf4 WatchSource:0}: Error finding container f8ac5dc47eeb1bd6216ea60a9b1a2a12bb078d66d19662a7a3c18ab21eaa8bf4: Status 404 returned error can't find the container with id f8ac5dc47eeb1bd6216ea60a9b1a2a12bb078d66d19662a7a3c18ab21eaa8bf4 Jul 08 18:30:00.631077 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:00.631049 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-dqncd" event={"ID":"b8231472-76af-4991-931d-d749b9dac434","Type":"ContainerStarted","Data":"f8ac5dc47eeb1bd6216ea60a9b1a2a12bb078d66d19662a7a3c18ab21eaa8bf4"} Jul 08 18:30:02.684019 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:02.683982 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp"] Jul 08 18:30:02.693252 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:02.692883 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" Jul 08 18:30:02.695730 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:02.695705 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-5c5fee5f-serving-cert\"" Jul 08 18:30:02.696687 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:02.696639 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp"] Jul 08 18:30:02.845902 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:02.845872 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c098c9f-038f-4916-ab6d-e13463e775b3-maas-api-tls\") pod \"maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp\" (UID: \"2c098c9f-038f-4916-ab6d-e13463e775b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" Jul 08 18:30:02.846090 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:02.845928 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c098c9f-038f-4916-ab6d-e13463e775b3-openshift-service-ca\") pod \"maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp\" (UID: \"2c098c9f-038f-4916-ab6d-e13463e775b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" Jul 08 18:30:02.846090 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:02.846042 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsqcr\" (UniqueName: \"kubernetes.io/projected/2c098c9f-038f-4916-ab6d-e13463e775b3-kube-api-access-tsqcr\") pod \"maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp\" (UID: \"2c098c9f-038f-4916-ab6d-e13463e775b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" Jul 08 18:30:02.947181 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:02.947113 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsqcr\" (UniqueName: \"kubernetes.io/projected/2c098c9f-038f-4916-ab6d-e13463e775b3-kube-api-access-tsqcr\") pod \"maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp\" (UID: \"2c098c9f-038f-4916-ab6d-e13463e775b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" Jul 08 18:30:02.947181 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:02.947173 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c098c9f-038f-4916-ab6d-e13463e775b3-maas-api-tls\") pod \"maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp\" (UID: \"2c098c9f-038f-4916-ab6d-e13463e775b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" Jul 08 18:30:02.947360 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:02.947206 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c098c9f-038f-4916-ab6d-e13463e775b3-openshift-service-ca\") pod \"maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp\" (UID: \"2c098c9f-038f-4916-ab6d-e13463e775b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" Jul 08 18:30:02.947400 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:30:02.947355 2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-serving-cert: secret "maas-api-e2e-ait-5c5fee5f-serving-cert" not found Jul 08 18:30:02.947448 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:30:02.947436 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c098c9f-038f-4916-ab6d-e13463e775b3-maas-api-tls podName:2c098c9f-038f-4916-ab6d-e13463e775b3 nodeName:}" failed. No retries permitted until 2026-07-08 18:30:03.447410293 +0000 UTC m=+1537.691308447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2c098c9f-038f-4916-ab6d-e13463e775b3-maas-api-tls") pod "maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" (UID: "2c098c9f-038f-4916-ab6d-e13463e775b3") : secret "maas-api-e2e-ait-5c5fee5f-serving-cert" not found Jul 08 18:30:02.947837 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:02.947820 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c098c9f-038f-4916-ab6d-e13463e775b3-openshift-service-ca\") pod \"maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp\" (UID: \"2c098c9f-038f-4916-ab6d-e13463e775b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" Jul 08 18:30:02.956787 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:02.956765 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsqcr\" (UniqueName: \"kubernetes.io/projected/2c098c9f-038f-4916-ab6d-e13463e775b3-kube-api-access-tsqcr\") pod \"maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp\" (UID: \"2c098c9f-038f-4916-ab6d-e13463e775b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" Jul 08 18:30:03.452065 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:03.452009 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c098c9f-038f-4916-ab6d-e13463e775b3-maas-api-tls\") pod \"maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp\" (UID: \"2c098c9f-038f-4916-ab6d-e13463e775b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" Jul 08 18:30:03.454432 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:03.454412 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c098c9f-038f-4916-ab6d-e13463e775b3-maas-api-tls\") pod \"maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp\" (UID: \"2c098c9f-038f-4916-ab6d-e13463e775b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" Jul 08 18:30:03.607175 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:03.607144 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" Jul 08 18:30:03.649282 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:03.649248 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-dqncd" event={"ID":"b8231472-76af-4991-931d-d749b9dac434","Type":"ContainerStarted","Data":"fb0b2c51c7ee352ac86ed118e1b9efb3a2a2b6cb9a8c7dd0a1bb152609e5cf32"} Jul 08 18:30:03.666510 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:03.666447 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-dqncd" podStartSLOduration=1.032609614 podStartE2EDuration="3.666427244s" totalImagesPullingTime="2.63381763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:30:03.665680995 +0000 UTC m=+1537.909579189" watchObservedRunningTime="2026-07-08 18:30:03.666427244 +0000 UTC m=+1537.910325412" Jul 08 18:30:03.748171 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:03.748149 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp"] Jul 08 18:30:03.749753 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:30:03.749725 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c098c9f_038f_4916_ab6d_e13463e775b3.slice/crio-983809726fbd7b8fa784558a339af5387306c7fbbc6c76e5e48ea6d1564d1f86 WatchSource:0}: Error finding container 983809726fbd7b8fa784558a339af5387306c7fbbc6c76e5e48ea6d1564d1f86: Status 404 returned error can't find the container with id 983809726fbd7b8fa784558a339af5387306c7fbbc6c76e5e48ea6d1564d1f86 Jul 08 18:30:04.655480 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:04.655442 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" event={"ID":"2c098c9f-038f-4916-ab6d-e13463e775b3","Type":"ContainerStarted","Data":"983809726fbd7b8fa784558a339af5387306c7fbbc6c76e5e48ea6d1564d1f86"} Jul 08 18:30:05.662016 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:05.661931 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" event={"ID":"2c098c9f-038f-4916-ab6d-e13463e775b3","Type":"ContainerStarted","Data":"6e4d3f4a503025166609cbae200302d885809334cacdbfdbecf4f3aac9d6ae43"} Jul 08 18:30:05.662442 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:05.662065 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" Jul 08 18:30:05.681778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:05.681732 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" podStartSLOduration=2.176378357 podStartE2EDuration="3.681719102s" totalImagesPullingTime="1.505340745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:30:05.680393687 +0000 UTC m=+1539.924291884" watchObservedRunningTime="2026-07-08 18:30:05.681719102 +0000 UTC m=+1539.925617266" Jul 08 18:30:08.104568 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.104530 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp"] Jul 08 18:30:08.104991 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.104731 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" podUID="2c098c9f-038f-4916-ab6d-e13463e775b3" containerName="maas-api" containerID="cri-o://6e4d3f4a503025166609cbae200302d885809334cacdbfdbecf4f3aac9d6ae43" gracePeriod=30 Jul 08 18:30:08.353396 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.353374 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" Jul 08 18:30:08.493852 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.493826 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsqcr\" (UniqueName: \"kubernetes.io/projected/2c098c9f-038f-4916-ab6d-e13463e775b3-kube-api-access-tsqcr\") pod \"2c098c9f-038f-4916-ab6d-e13463e775b3\" (UID: \"2c098c9f-038f-4916-ab6d-e13463e775b3\") " Jul 08 18:30:08.493975 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.493880 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c098c9f-038f-4916-ab6d-e13463e775b3-maas-api-tls\") pod \"2c098c9f-038f-4916-ab6d-e13463e775b3\" (UID: \"2c098c9f-038f-4916-ab6d-e13463e775b3\") " Jul 08 18:30:08.493975 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.493917 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c098c9f-038f-4916-ab6d-e13463e775b3-openshift-service-ca\") pod \"2c098c9f-038f-4916-ab6d-e13463e775b3\" (UID: \"2c098c9f-038f-4916-ab6d-e13463e775b3\") " Jul 08 18:30:08.494340 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.494311 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c098c9f-038f-4916-ab6d-e13463e775b3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2c098c9f-038f-4916-ab6d-e13463e775b3" (UID: "2c098c9f-038f-4916-ab6d-e13463e775b3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:30:08.496019 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.495994 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c098c9f-038f-4916-ab6d-e13463e775b3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2c098c9f-038f-4916-ab6d-e13463e775b3" (UID: "2c098c9f-038f-4916-ab6d-e13463e775b3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:30:08.496140 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.496044 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c098c9f-038f-4916-ab6d-e13463e775b3-kube-api-access-tsqcr" (OuterVolumeSpecName: "kube-api-access-tsqcr") pod "2c098c9f-038f-4916-ab6d-e13463e775b3" (UID: "2c098c9f-038f-4916-ab6d-e13463e775b3"). InnerVolumeSpecName "kube-api-access-tsqcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:30:08.594442 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.594418 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c098c9f-038f-4916-ab6d-e13463e775b3-maas-api-tls\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:30:08.594442 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.594441 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c098c9f-038f-4916-ab6d-e13463e775b3-openshift-service-ca\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:30:08.594570 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.594452 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsqcr\" (UniqueName: \"kubernetes.io/projected/2c098c9f-038f-4916-ab6d-e13463e775b3-kube-api-access-tsqcr\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:30:08.679002 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.678978 2574 generic.go:356] "Generic (PLEG): container finished" podID="2c098c9f-038f-4916-ab6d-e13463e775b3" containerID="6e4d3f4a503025166609cbae200302d885809334cacdbfdbecf4f3aac9d6ae43" exitCode=0 Jul 08 18:30:08.679107 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.679014 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" Jul 08 18:30:08.679107 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.679065 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" event={"ID":"2c098c9f-038f-4916-ab6d-e13463e775b3","Type":"ContainerDied","Data":"6e4d3f4a503025166609cbae200302d885809334cacdbfdbecf4f3aac9d6ae43"} Jul 08 18:30:08.679183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.679119 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp" event={"ID":"2c098c9f-038f-4916-ab6d-e13463e775b3","Type":"ContainerDied","Data":"983809726fbd7b8fa784558a339af5387306c7fbbc6c76e5e48ea6d1564d1f86"} Jul 08 18:30:08.679183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.679145 2574 scope.go:117] "RemoveContainer" containerID="6e4d3f4a503025166609cbae200302d885809334cacdbfdbecf4f3aac9d6ae43" Jul 08 18:30:08.687907 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.687893 2574 scope.go:117] "RemoveContainer" containerID="6e4d3f4a503025166609cbae200302d885809334cacdbfdbecf4f3aac9d6ae43" Jul 08 18:30:08.688208 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:30:08.688191 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e4d3f4a503025166609cbae200302d885809334cacdbfdbecf4f3aac9d6ae43\": container with ID starting with 6e4d3f4a503025166609cbae200302d885809334cacdbfdbecf4f3aac9d6ae43 not found: ID does not exist" containerID="6e4d3f4a503025166609cbae200302d885809334cacdbfdbecf4f3aac9d6ae43" Jul 08 18:30:08.688281 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.688214 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e4d3f4a503025166609cbae200302d885809334cacdbfdbecf4f3aac9d6ae43"} err="failed to get container status \"6e4d3f4a503025166609cbae200302d885809334cacdbfdbecf4f3aac9d6ae43\": rpc error: code = NotFound desc = could not find container \"6e4d3f4a503025166609cbae200302d885809334cacdbfdbecf4f3aac9d6ae43\": container with ID starting with 6e4d3f4a503025166609cbae200302d885809334cacdbfdbecf4f3aac9d6ae43 not found: ID does not exist" Jul 08 18:30:08.700978 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.700951 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp"] Jul 08 18:30:08.707974 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:08.707947 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5c5fee5f-55c775fbdc-fk8bp"] Jul 08 18:30:10.270282 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:10.270239 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c098c9f-038f-4916-ab6d-e13463e775b3" path="/var/lib/kubelet/pods/2c098c9f-038f-4916-ab6d-e13463e775b3/volumes" Jul 08 18:30:21.499962 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:21.499929 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs"] Jul 08 18:30:21.500463 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:21.500274 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c098c9f-038f-4916-ab6d-e13463e775b3" containerName="maas-api" Jul 08 18:30:21.500463 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:21.500290 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c098c9f-038f-4916-ab6d-e13463e775b3" containerName="maas-api" Jul 08 18:30:21.500463 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:21.500350 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c098c9f-038f-4916-ab6d-e13463e775b3" containerName="maas-api" Jul 08 18:30:21.507843 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:21.507822 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs" Jul 08 18:30:21.510550 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:21.510528 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-feb98e91-serving-cert\"" Jul 08 18:30:21.512886 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:21.512862 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs"] Jul 08 18:30:21.691598 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:21.691565 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67d56958-d640-4bf6-a14c-2ec6e4536502-maas-api-tls\") pod \"maas-api-e2e-derive-feb98e91-68d55b8f79-298zs\" (UID: \"67d56958-d640-4bf6-a14c-2ec6e4536502\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs" Jul 08 18:30:21.691769 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:21.691636 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbm54\" (UniqueName: \"kubernetes.io/projected/67d56958-d640-4bf6-a14c-2ec6e4536502-kube-api-access-pbm54\") pod \"maas-api-e2e-derive-feb98e91-68d55b8f79-298zs\" (UID: \"67d56958-d640-4bf6-a14c-2ec6e4536502\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs" Jul 08 18:30:21.691769 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:21.691715 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67d56958-d640-4bf6-a14c-2ec6e4536502-openshift-service-ca\") pod \"maas-api-e2e-derive-feb98e91-68d55b8f79-298zs\" (UID: \"67d56958-d640-4bf6-a14c-2ec6e4536502\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs" Jul 08 18:30:21.792951 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:21.792881 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67d56958-d640-4bf6-a14c-2ec6e4536502-maas-api-tls\") pod \"maas-api-e2e-derive-feb98e91-68d55b8f79-298zs\" (UID: \"67d56958-d640-4bf6-a14c-2ec6e4536502\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs" Jul 08 18:30:21.792951 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:21.792924 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbm54\" (UniqueName: \"kubernetes.io/projected/67d56958-d640-4bf6-a14c-2ec6e4536502-kube-api-access-pbm54\") pod \"maas-api-e2e-derive-feb98e91-68d55b8f79-298zs\" (UID: \"67d56958-d640-4bf6-a14c-2ec6e4536502\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs" Jul 08 18:30:21.793167 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:21.792960 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67d56958-d640-4bf6-a14c-2ec6e4536502-openshift-service-ca\") pod \"maas-api-e2e-derive-feb98e91-68d55b8f79-298zs\" (UID: \"67d56958-d640-4bf6-a14c-2ec6e4536502\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs" Jul 08 18:30:21.793654 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:21.793632 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67d56958-d640-4bf6-a14c-2ec6e4536502-openshift-service-ca\") pod \"maas-api-e2e-derive-feb98e91-68d55b8f79-298zs\" (UID: \"67d56958-d640-4bf6-a14c-2ec6e4536502\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs" Jul 08 18:30:21.795469 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:21.795438 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67d56958-d640-4bf6-a14c-2ec6e4536502-maas-api-tls\") pod \"maas-api-e2e-derive-feb98e91-68d55b8f79-298zs\" (UID: \"67d56958-d640-4bf6-a14c-2ec6e4536502\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs" Jul 08 18:30:21.801717 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:21.801686 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbm54\" (UniqueName: \"kubernetes.io/projected/67d56958-d640-4bf6-a14c-2ec6e4536502-kube-api-access-pbm54\") pod \"maas-api-e2e-derive-feb98e91-68d55b8f79-298zs\" (UID: \"67d56958-d640-4bf6-a14c-2ec6e4536502\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs" Jul 08 18:30:21.819518 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:21.819494 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs" Jul 08 18:30:21.967157 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:21.962530 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs"] Jul 08 18:30:22.750201 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:22.750109 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs" event={"ID":"67d56958-d640-4bf6-a14c-2ec6e4536502","Type":"ContainerStarted","Data":"80bca0e0cdbd7867cdd0877a864b9a884d367ac52ff91e865a6699108bf5a63f"} Jul 08 18:30:22.750201 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:22.750165 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs" event={"ID":"67d56958-d640-4bf6-a14c-2ec6e4536502","Type":"ContainerStarted","Data":"9716e018eb8b41e7727ef7f1ef7a2a22b13572bf43baaccc9ba383a7030985dc"} Jul 08 18:30:22.750665 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:22.750312 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs" Jul 08 18:30:22.788885 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:22.788842 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs" podStartSLOduration=1.275497995 podStartE2EDuration="1.788827558s" totalImagesPullingTime="513.329563ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:30:22.78745327 +0000 UTC m=+1557.031351458" watchObservedRunningTime="2026-07-08 18:30:22.788827558 +0000 UTC m=+1557.032725723" Jul 08 18:30:26.349124 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.349098 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs"] Jul 08 18:30:26.349481 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.349313 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs" podUID="67d56958-d640-4bf6-a14c-2ec6e4536502" containerName="maas-api" containerID="cri-o://80bca0e0cdbd7867cdd0877a864b9a884d367ac52ff91e865a6699108bf5a63f" gracePeriod=30 Jul 08 18:30:26.600881 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.600856 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs" Jul 08 18:30:26.628297 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.628272 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbm54\" (UniqueName: \"kubernetes.io/projected/67d56958-d640-4bf6-a14c-2ec6e4536502-kube-api-access-pbm54\") pod \"67d56958-d640-4bf6-a14c-2ec6e4536502\" (UID: \"67d56958-d640-4bf6-a14c-2ec6e4536502\") " Jul 08 18:30:26.628444 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.628324 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67d56958-d640-4bf6-a14c-2ec6e4536502-maas-api-tls\") pod \"67d56958-d640-4bf6-a14c-2ec6e4536502\" (UID: \"67d56958-d640-4bf6-a14c-2ec6e4536502\") " Jul 08 18:30:26.628444 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.628373 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67d56958-d640-4bf6-a14c-2ec6e4536502-openshift-service-ca\") pod \"67d56958-d640-4bf6-a14c-2ec6e4536502\" (UID: \"67d56958-d640-4bf6-a14c-2ec6e4536502\") " Jul 08 18:30:26.628736 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.628714 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67d56958-d640-4bf6-a14c-2ec6e4536502-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "67d56958-d640-4bf6-a14c-2ec6e4536502" (UID: "67d56958-d640-4bf6-a14c-2ec6e4536502"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:30:26.630446 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.630426 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67d56958-d640-4bf6-a14c-2ec6e4536502-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "67d56958-d640-4bf6-a14c-2ec6e4536502" (UID: "67d56958-d640-4bf6-a14c-2ec6e4536502"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:30:26.630824 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.630798 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67d56958-d640-4bf6-a14c-2ec6e4536502-kube-api-access-pbm54" (OuterVolumeSpecName: "kube-api-access-pbm54") pod "67d56958-d640-4bf6-a14c-2ec6e4536502" (UID: "67d56958-d640-4bf6-a14c-2ec6e4536502"). InnerVolumeSpecName "kube-api-access-pbm54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:30:26.729710 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.729683 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67d56958-d640-4bf6-a14c-2ec6e4536502-maas-api-tls\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:30:26.729797 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.729711 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67d56958-d640-4bf6-a14c-2ec6e4536502-openshift-service-ca\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:30:26.729797 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.729726 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbm54\" (UniqueName: \"kubernetes.io/projected/67d56958-d640-4bf6-a14c-2ec6e4536502-kube-api-access-pbm54\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:30:26.769142 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.769113 2574 generic.go:356] "Generic (PLEG): container finished" podID="67d56958-d640-4bf6-a14c-2ec6e4536502" containerID="80bca0e0cdbd7867cdd0877a864b9a884d367ac52ff91e865a6699108bf5a63f" exitCode=0 Jul 08 18:30:26.769244 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.769161 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs" event={"ID":"67d56958-d640-4bf6-a14c-2ec6e4536502","Type":"ContainerDied","Data":"80bca0e0cdbd7867cdd0877a864b9a884d367ac52ff91e865a6699108bf5a63f"} Jul 08 18:30:26.769244 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.769165 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs" Jul 08 18:30:26.769244 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.769201 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs" event={"ID":"67d56958-d640-4bf6-a14c-2ec6e4536502","Type":"ContainerDied","Data":"9716e018eb8b41e7727ef7f1ef7a2a22b13572bf43baaccc9ba383a7030985dc"} Jul 08 18:30:26.769244 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.769222 2574 scope.go:117] "RemoveContainer" containerID="80bca0e0cdbd7867cdd0877a864b9a884d367ac52ff91e865a6699108bf5a63f" Jul 08 18:30:26.778113 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.778094 2574 scope.go:117] "RemoveContainer" containerID="80bca0e0cdbd7867cdd0877a864b9a884d367ac52ff91e865a6699108bf5a63f" Jul 08 18:30:26.778344 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:30:26.778327 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80bca0e0cdbd7867cdd0877a864b9a884d367ac52ff91e865a6699108bf5a63f\": container with ID starting with 80bca0e0cdbd7867cdd0877a864b9a884d367ac52ff91e865a6699108bf5a63f not found: ID does not exist" containerID="80bca0e0cdbd7867cdd0877a864b9a884d367ac52ff91e865a6699108bf5a63f" Jul 08 18:30:26.778391 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.778352 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80bca0e0cdbd7867cdd0877a864b9a884d367ac52ff91e865a6699108bf5a63f"} err="failed to get container status \"80bca0e0cdbd7867cdd0877a864b9a884d367ac52ff91e865a6699108bf5a63f\": rpc error: code = NotFound desc = could not find container \"80bca0e0cdbd7867cdd0877a864b9a884d367ac52ff91e865a6699108bf5a63f\": container with ID starting with 80bca0e0cdbd7867cdd0877a864b9a884d367ac52ff91e865a6699108bf5a63f not found: ID does not exist" Jul 08 18:30:26.791859 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.791837 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs"] Jul 08 18:30:26.801607 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:26.796544 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-feb98e91-68d55b8f79-298zs"] Jul 08 18:30:28.272358 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:30:28.272329 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67d56958-d640-4bf6-a14c-2ec6e4536502" path="/var/lib/kubelet/pods/67d56958-d640-4bf6-a14c-2ec6e4536502/volumes" Jul 08 18:31:00.010808 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:31:00.010780 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725590-dqncd"] Jul 08 18:31:00.011289 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:31:00.010955 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-dqncd" podUID="b8231472-76af-4991-931d-d749b9dac434" containerName="cleanup" containerID="cri-o://fb0b2c51c7ee352ac86ed118e1b9efb3a2a2b6cb9a8c7dd0a1bb152609e5cf32" gracePeriod=30 Jul 08 18:31:30.106582 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:31:30.106546 2574 generic.go:356] "Generic (PLEG): container finished" podID="b8231472-76af-4991-931d-d749b9dac434" containerID="fb0b2c51c7ee352ac86ed118e1b9efb3a2a2b6cb9a8c7dd0a1bb152609e5cf32" exitCode=137 Jul 08 18:31:30.106940 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:31:30.106649 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-dqncd" event={"ID":"b8231472-76af-4991-931d-d749b9dac434","Type":"ContainerDied","Data":"fb0b2c51c7ee352ac86ed118e1b9efb3a2a2b6cb9a8c7dd0a1bb152609e5cf32"} Jul 08 18:31:30.187204 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:31:30.187183 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-dqncd" Jul 08 18:31:30.298260 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:31:30.298199 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d58d7\" (UniqueName: \"kubernetes.io/projected/b8231472-76af-4991-931d-d749b9dac434-kube-api-access-d58d7\") pod \"b8231472-76af-4991-931d-d749b9dac434\" (UID: \"b8231472-76af-4991-931d-d749b9dac434\") " Jul 08 18:31:30.300306 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:31:30.300283 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8231472-76af-4991-931d-d749b9dac434-kube-api-access-d58d7" (OuterVolumeSpecName: "kube-api-access-d58d7") pod "b8231472-76af-4991-931d-d749b9dac434" (UID: "b8231472-76af-4991-931d-d749b9dac434"). InnerVolumeSpecName "kube-api-access-d58d7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:31:30.398804 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:31:30.398774 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d58d7\" (UniqueName: \"kubernetes.io/projected/b8231472-76af-4991-931d-d749b9dac434-kube-api-access-d58d7\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:31:31.113042 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:31:31.112994 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-dqncd" Jul 08 18:31:31.113536 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:31:31.112989 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-dqncd" event={"ID":"b8231472-76af-4991-931d-d749b9dac434","Type":"ContainerDied","Data":"f8ac5dc47eeb1bd6216ea60a9b1a2a12bb078d66d19662a7a3c18ab21eaa8bf4"} Jul 08 18:31:31.113536 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:31:31.113162 2574 scope.go:117] "RemoveContainer" containerID="fb0b2c51c7ee352ac86ed118e1b9efb3a2a2b6cb9a8c7dd0a1bb152609e5cf32" Jul 08 18:31:31.135748 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:31:31.135725 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725590-dqncd"] Jul 08 18:31:31.137839 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:31:31.137817 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725590-dqncd"] Jul 08 18:31:32.270390 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:31:32.270356 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8231472-76af-4991-931d-d749b9dac434" path="/var/lib/kubelet/pods/b8231472-76af-4991-931d-d749b9dac434/volumes" Jul 08 18:32:13.306901 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:13.306867 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8"] Jul 08 18:32:13.307480 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:13.307316 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8231472-76af-4991-931d-d749b9dac434" containerName="cleanup" Jul 08 18:32:13.307480 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:13.307336 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8231472-76af-4991-931d-d749b9dac434" containerName="cleanup" Jul 08 18:32:13.307480 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:13.307372 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67d56958-d640-4bf6-a14c-2ec6e4536502" containerName="maas-api" Jul 08 18:32:13.307480 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:13.307380 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="67d56958-d640-4bf6-a14c-2ec6e4536502" containerName="maas-api" Jul 08 18:32:13.307480 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:13.307459 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8231472-76af-4991-931d-d749b9dac434" containerName="cleanup" Jul 08 18:32:13.307480 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:13.307472 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="67d56958-d640-4bf6-a14c-2ec6e4536502" containerName="maas-api" Jul 08 18:32:13.310790 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:13.310772 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" Jul 08 18:32:13.313525 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:13.313508 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-cd670168-serving-cert\"" Jul 08 18:32:13.318218 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:13.318196 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af09ccdc-8221-4e95-97d7-4c6a71730468-maas-api-tls\") pod \"maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8\" (UID: \"af09ccdc-8221-4e95-97d7-4c6a71730468\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" Jul 08 18:32:13.319386 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:13.318671 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af09ccdc-8221-4e95-97d7-4c6a71730468-openshift-service-ca\") pod \"maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8\" (UID: \"af09ccdc-8221-4e95-97d7-4c6a71730468\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" Jul 08 18:32:13.319386 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:13.318756 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m7vh\" (UniqueName: \"kubernetes.io/projected/af09ccdc-8221-4e95-97d7-4c6a71730468-kube-api-access-5m7vh\") pod \"maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8\" (UID: \"af09ccdc-8221-4e95-97d7-4c6a71730468\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" Jul 08 18:32:13.321862 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:13.321837 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8"] Jul 08 18:32:13.419848 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:13.419817 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m7vh\" (UniqueName: \"kubernetes.io/projected/af09ccdc-8221-4e95-97d7-4c6a71730468-kube-api-access-5m7vh\") pod \"maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8\" (UID: \"af09ccdc-8221-4e95-97d7-4c6a71730468\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" Jul 08 18:32:13.420091 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:13.420073 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af09ccdc-8221-4e95-97d7-4c6a71730468-maas-api-tls\") pod \"maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8\" (UID: \"af09ccdc-8221-4e95-97d7-4c6a71730468\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" Jul 08 18:32:13.420545 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:32:13.420213 2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-serving-cert: secret "maas-api-e2e-mt-cd670168-serving-cert" not found Jul 08 18:32:13.420545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:13.420275 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af09ccdc-8221-4e95-97d7-4c6a71730468-openshift-service-ca\") pod \"maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8\" (UID: \"af09ccdc-8221-4e95-97d7-4c6a71730468\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" Jul 08 18:32:13.420545 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:32:13.420296 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af09ccdc-8221-4e95-97d7-4c6a71730468-maas-api-tls podName:af09ccdc-8221-4e95-97d7-4c6a71730468 nodeName:}" failed. No retries permitted until 2026-07-08 18:32:13.920275994 +0000 UTC m=+1668.164174157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/af09ccdc-8221-4e95-97d7-4c6a71730468-maas-api-tls") pod "maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" (UID: "af09ccdc-8221-4e95-97d7-4c6a71730468") : secret "maas-api-e2e-mt-cd670168-serving-cert" not found Jul 08 18:32:13.420968 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:13.420935 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af09ccdc-8221-4e95-97d7-4c6a71730468-openshift-service-ca\") pod \"maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8\" (UID: \"af09ccdc-8221-4e95-97d7-4c6a71730468\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" Jul 08 18:32:13.434064 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:13.434007 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m7vh\" (UniqueName: \"kubernetes.io/projected/af09ccdc-8221-4e95-97d7-4c6a71730468-kube-api-access-5m7vh\") pod \"maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8\" (UID: \"af09ccdc-8221-4e95-97d7-4c6a71730468\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" Jul 08 18:32:13.923989 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:13.923958 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af09ccdc-8221-4e95-97d7-4c6a71730468-maas-api-tls\") pod \"maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8\" (UID: \"af09ccdc-8221-4e95-97d7-4c6a71730468\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" Jul 08 18:32:13.926429 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:13.926400 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af09ccdc-8221-4e95-97d7-4c6a71730468-maas-api-tls\") pod \"maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8\" (UID: \"af09ccdc-8221-4e95-97d7-4c6a71730468\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" Jul 08 18:32:14.222246 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:14.222172 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" Jul 08 18:32:14.355942 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:14.355915 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8"] Jul 08 18:32:14.357589 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:32:14.357564 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf09ccdc_8221_4e95_97d7_4c6a71730468.slice/crio-0724d7795829ec362e0d52787e27c440aecec241cf194e72614e39123f8924c9 WatchSource:0}: Error finding container 0724d7795829ec362e0d52787e27c440aecec241cf194e72614e39123f8924c9: Status 404 returned error can't find the container with id 0724d7795829ec362e0d52787e27c440aecec241cf194e72614e39123f8924c9 Jul 08 18:32:15.342954 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:15.342915 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" event={"ID":"af09ccdc-8221-4e95-97d7-4c6a71730468","Type":"ContainerStarted","Data":"ae3816cba039da0a08c2b95b30a0b337731f66e448d3ce2908bd86b874bd03d4"} Jul 08 18:32:15.343139 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:15.342967 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" event={"ID":"af09ccdc-8221-4e95-97d7-4c6a71730468","Type":"ContainerStarted","Data":"0724d7795829ec362e0d52787e27c440aecec241cf194e72614e39123f8924c9"} Jul 08 18:32:15.343193 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:15.343147 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" Jul 08 18:32:15.363076 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:15.363036 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" podStartSLOduration=1.882402328 podStartE2EDuration="2.363006569s" totalImagesPullingTime="480.604241ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:32:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:32:15.361122911 +0000 UTC m=+1669.605021097" watchObservedRunningTime="2026-07-08 18:32:15.363006569 +0000 UTC m=+1669.606904738" Jul 08 18:32:21.353523 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:21.353498 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" Jul 08 18:32:25.781338 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:25.781301 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8"] Jul 08 18:32:25.781804 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:25.781521 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" podUID="af09ccdc-8221-4e95-97d7-4c6a71730468" containerName="maas-api" containerID="cri-o://ae3816cba039da0a08c2b95b30a0b337731f66e448d3ce2908bd86b874bd03d4" gracePeriod=30 Jul 08 18:32:26.030723 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:26.030699 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" Jul 08 18:32:26.112305 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:26.112246 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af09ccdc-8221-4e95-97d7-4c6a71730468-openshift-service-ca\") pod \"af09ccdc-8221-4e95-97d7-4c6a71730468\" (UID: \"af09ccdc-8221-4e95-97d7-4c6a71730468\") " Jul 08 18:32:26.112305 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:26.112278 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af09ccdc-8221-4e95-97d7-4c6a71730468-maas-api-tls\") pod \"af09ccdc-8221-4e95-97d7-4c6a71730468\" (UID: \"af09ccdc-8221-4e95-97d7-4c6a71730468\") " Jul 08 18:32:26.112440 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:26.112374 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m7vh\" (UniqueName: \"kubernetes.io/projected/af09ccdc-8221-4e95-97d7-4c6a71730468-kube-api-access-5m7vh\") pod \"af09ccdc-8221-4e95-97d7-4c6a71730468\" (UID: \"af09ccdc-8221-4e95-97d7-4c6a71730468\") " Jul 08 18:32:26.112627 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:26.112609 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af09ccdc-8221-4e95-97d7-4c6a71730468-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "af09ccdc-8221-4e95-97d7-4c6a71730468" (UID: "af09ccdc-8221-4e95-97d7-4c6a71730468"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:32:26.114354 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:26.114333 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af09ccdc-8221-4e95-97d7-4c6a71730468-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "af09ccdc-8221-4e95-97d7-4c6a71730468" (UID: "af09ccdc-8221-4e95-97d7-4c6a71730468"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:32:26.114545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:26.114523 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af09ccdc-8221-4e95-97d7-4c6a71730468-kube-api-access-5m7vh" (OuterVolumeSpecName: "kube-api-access-5m7vh") pod "af09ccdc-8221-4e95-97d7-4c6a71730468" (UID: "af09ccdc-8221-4e95-97d7-4c6a71730468"). InnerVolumeSpecName "kube-api-access-5m7vh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:32:26.213777 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:26.213754 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af09ccdc-8221-4e95-97d7-4c6a71730468-openshift-service-ca\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:32:26.213777 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:26.213778 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af09ccdc-8221-4e95-97d7-4c6a71730468-maas-api-tls\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:32:26.213901 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:26.213788 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m7vh\" (UniqueName: \"kubernetes.io/projected/af09ccdc-8221-4e95-97d7-4c6a71730468-kube-api-access-5m7vh\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:32:26.395302 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:26.395242 2574 generic.go:356] "Generic (PLEG): container finished" podID="af09ccdc-8221-4e95-97d7-4c6a71730468" containerID="ae3816cba039da0a08c2b95b30a0b337731f66e448d3ce2908bd86b874bd03d4" exitCode=0 Jul 08 18:32:26.395302 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:26.395280 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" Jul 08 18:32:26.395302 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:26.395293 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" event={"ID":"af09ccdc-8221-4e95-97d7-4c6a71730468","Type":"ContainerDied","Data":"ae3816cba039da0a08c2b95b30a0b337731f66e448d3ce2908bd86b874bd03d4"} Jul 08 18:32:26.395473 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:26.395341 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8" event={"ID":"af09ccdc-8221-4e95-97d7-4c6a71730468","Type":"ContainerDied","Data":"0724d7795829ec362e0d52787e27c440aecec241cf194e72614e39123f8924c9"} Jul 08 18:32:26.395473 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:26.395362 2574 scope.go:117] "RemoveContainer" containerID="ae3816cba039da0a08c2b95b30a0b337731f66e448d3ce2908bd86b874bd03d4" Jul 08 18:32:26.403527 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:26.403508 2574 scope.go:117] "RemoveContainer" containerID="ae3816cba039da0a08c2b95b30a0b337731f66e448d3ce2908bd86b874bd03d4" Jul 08 18:32:26.403777 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:32:26.403760 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae3816cba039da0a08c2b95b30a0b337731f66e448d3ce2908bd86b874bd03d4\": container with ID starting with ae3816cba039da0a08c2b95b30a0b337731f66e448d3ce2908bd86b874bd03d4 not found: ID does not exist" containerID="ae3816cba039da0a08c2b95b30a0b337731f66e448d3ce2908bd86b874bd03d4" Jul 08 18:32:26.403831 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:26.403785 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae3816cba039da0a08c2b95b30a0b337731f66e448d3ce2908bd86b874bd03d4"} err="failed to get container status \"ae3816cba039da0a08c2b95b30a0b337731f66e448d3ce2908bd86b874bd03d4\": rpc error: code = NotFound desc = could not find container \"ae3816cba039da0a08c2b95b30a0b337731f66e448d3ce2908bd86b874bd03d4\": container with ID starting with ae3816cba039da0a08c2b95b30a0b337731f66e448d3ce2908bd86b874bd03d4 not found: ID does not exist" Jul 08 18:32:26.413521 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:26.413501 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8"] Jul 08 18:32:26.416934 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:26.416905 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cd670168-6f945c6bc7-jldd8"] Jul 08 18:32:28.270651 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:28.270614 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af09ccdc-8221-4e95-97d7-4c6a71730468" path="/var/lib/kubelet/pods/af09ccdc-8221-4e95-97d7-4c6a71730468/volumes" Jul 08 18:32:55.379835 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:55.379765 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9"] Jul 08 18:32:55.380256 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:55.380086 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af09ccdc-8221-4e95-97d7-4c6a71730468" containerName="maas-api" Jul 08 18:32:55.380256 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:55.380097 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="af09ccdc-8221-4e95-97d7-4c6a71730468" containerName="maas-api" Jul 08 18:32:55.380256 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:55.380145 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="af09ccdc-8221-4e95-97d7-4c6a71730468" containerName="maas-api" Jul 08 18:32:55.383323 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:55.383295 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" Jul 08 18:32:55.385759 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:55.385736 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-3ef261af-serving-cert\"" Jul 08 18:32:55.394923 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:55.394904 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9"] Jul 08 18:32:55.531584 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:55.531550 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fbf11e6-0623-4072-915e-64b38a25a8b9-maas-api-tls\") pod \"maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9\" (UID: \"2fbf11e6-0623-4072-915e-64b38a25a8b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" Jul 08 18:32:55.531584 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:55.531584 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22wp8\" (UniqueName: \"kubernetes.io/projected/2fbf11e6-0623-4072-915e-64b38a25a8b9-kube-api-access-22wp8\") pod \"maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9\" (UID: \"2fbf11e6-0623-4072-915e-64b38a25a8b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" Jul 08 18:32:55.531778 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:55.531647 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fbf11e6-0623-4072-915e-64b38a25a8b9-openshift-service-ca\") pod \"maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9\" (UID: \"2fbf11e6-0623-4072-915e-64b38a25a8b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" Jul 08 18:32:55.633069 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:55.632985 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fbf11e6-0623-4072-915e-64b38a25a8b9-maas-api-tls\") pod \"maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9\" (UID: \"2fbf11e6-0623-4072-915e-64b38a25a8b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" Jul 08 18:32:55.633069 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:55.633016 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22wp8\" (UniqueName: \"kubernetes.io/projected/2fbf11e6-0623-4072-915e-64b38a25a8b9-kube-api-access-22wp8\") pod \"maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9\" (UID: \"2fbf11e6-0623-4072-915e-64b38a25a8b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" Jul 08 18:32:55.633216 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:55.633092 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fbf11e6-0623-4072-915e-64b38a25a8b9-openshift-service-ca\") pod \"maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9\" (UID: \"2fbf11e6-0623-4072-915e-64b38a25a8b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" Jul 08 18:32:55.633749 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:55.633732 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fbf11e6-0623-4072-915e-64b38a25a8b9-openshift-service-ca\") pod \"maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9\" (UID: \"2fbf11e6-0623-4072-915e-64b38a25a8b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" Jul 08 18:32:55.635398 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:55.635378 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fbf11e6-0623-4072-915e-64b38a25a8b9-maas-api-tls\") pod \"maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9\" (UID: \"2fbf11e6-0623-4072-915e-64b38a25a8b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" Jul 08 18:32:55.640834 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:55.640812 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22wp8\" (UniqueName: \"kubernetes.io/projected/2fbf11e6-0623-4072-915e-64b38a25a8b9-kube-api-access-22wp8\") pod \"maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9\" (UID: \"2fbf11e6-0623-4072-915e-64b38a25a8b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" Jul 08 18:32:55.694828 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:55.694648 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" Jul 08 18:32:55.838462 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:55.838437 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9"] Jul 08 18:32:55.839847 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:32:55.839817 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fbf11e6_0623_4072_915e_64b38a25a8b9.slice/crio-27f1f955404ad8f1e22fa5cf4fb6bd302c05a353b4be55077340e45af6d3c7ea WatchSource:0}: Error finding container 27f1f955404ad8f1e22fa5cf4fb6bd302c05a353b4be55077340e45af6d3c7ea: Status 404 returned error can't find the container with id 27f1f955404ad8f1e22fa5cf4fb6bd302c05a353b4be55077340e45af6d3c7ea Jul 08 18:32:56.542629 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:56.542591 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" event={"ID":"2fbf11e6-0623-4072-915e-64b38a25a8b9","Type":"ContainerStarted","Data":"fc355d1b021d551394b20e07ccbcb1d6713c29299a1bdaa15e1a908648a99b71"} Jul 08 18:32:56.543043 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:56.542641 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" event={"ID":"2fbf11e6-0623-4072-915e-64b38a25a8b9","Type":"ContainerStarted","Data":"27f1f955404ad8f1e22fa5cf4fb6bd302c05a353b4be55077340e45af6d3c7ea"} Jul 08 18:32:56.543043 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:56.542723 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" Jul 08 18:32:56.564394 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:32:56.564346 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" podStartSLOduration=1.267917793 podStartE2EDuration="1.564333202s" totalImagesPullingTime="296.415409ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:32:56.562143952 +0000 UTC m=+1710.806042145" watchObservedRunningTime="2026-07-08 18:32:56.564333202 +0000 UTC m=+1710.808231366" Jul 08 18:33:02.553768 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:02.553744 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" Jul 08 18:33:32.604127 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:32.604086 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9"] Jul 08 18:33:32.604653 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:32.604315 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" podUID="2fbf11e6-0623-4072-915e-64b38a25a8b9" containerName="maas-api" containerID="cri-o://fc355d1b021d551394b20e07ccbcb1d6713c29299a1bdaa15e1a908648a99b71" gracePeriod=30 Jul 08 18:33:32.844467 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:32.844437 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" Jul 08 18:33:32.916118 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:32.916046 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fbf11e6-0623-4072-915e-64b38a25a8b9-openshift-service-ca\") pod \"2fbf11e6-0623-4072-915e-64b38a25a8b9\" (UID: \"2fbf11e6-0623-4072-915e-64b38a25a8b9\") " Jul 08 18:33:32.916261 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:32.916144 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fbf11e6-0623-4072-915e-64b38a25a8b9-maas-api-tls\") pod \"2fbf11e6-0623-4072-915e-64b38a25a8b9\" (UID: \"2fbf11e6-0623-4072-915e-64b38a25a8b9\") " Jul 08 18:33:32.916261 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:32.916198 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22wp8\" (UniqueName: \"kubernetes.io/projected/2fbf11e6-0623-4072-915e-64b38a25a8b9-kube-api-access-22wp8\") pod \"2fbf11e6-0623-4072-915e-64b38a25a8b9\" (UID: \"2fbf11e6-0623-4072-915e-64b38a25a8b9\") " Jul 08 18:33:32.916438 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:32.916414 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fbf11e6-0623-4072-915e-64b38a25a8b9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2fbf11e6-0623-4072-915e-64b38a25a8b9" (UID: "2fbf11e6-0623-4072-915e-64b38a25a8b9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:33:32.918374 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:32.918345 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fbf11e6-0623-4072-915e-64b38a25a8b9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2fbf11e6-0623-4072-915e-64b38a25a8b9" (UID: "2fbf11e6-0623-4072-915e-64b38a25a8b9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:33:32.918374 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:32.918364 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fbf11e6-0623-4072-915e-64b38a25a8b9-kube-api-access-22wp8" (OuterVolumeSpecName: "kube-api-access-22wp8") pod "2fbf11e6-0623-4072-915e-64b38a25a8b9" (UID: "2fbf11e6-0623-4072-915e-64b38a25a8b9"). InnerVolumeSpecName "kube-api-access-22wp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:33:33.017062 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:33.017019 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fbf11e6-0623-4072-915e-64b38a25a8b9-openshift-service-ca\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:33:33.017062 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:33.017055 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fbf11e6-0623-4072-915e-64b38a25a8b9-maas-api-tls\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:33:33.017062 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:33.017065 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22wp8\" (UniqueName: \"kubernetes.io/projected/2fbf11e6-0623-4072-915e-64b38a25a8b9-kube-api-access-22wp8\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:33:33.723082 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:33.723019 2574 generic.go:356] "Generic (PLEG): container finished" podID="2fbf11e6-0623-4072-915e-64b38a25a8b9" containerID="fc355d1b021d551394b20e07ccbcb1d6713c29299a1bdaa15e1a908648a99b71" exitCode=0 Jul 08 18:33:33.723082 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:33.723080 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" Jul 08 18:33:33.723613 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:33.723112 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" event={"ID":"2fbf11e6-0623-4072-915e-64b38a25a8b9","Type":"ContainerDied","Data":"fc355d1b021d551394b20e07ccbcb1d6713c29299a1bdaa15e1a908648a99b71"} Jul 08 18:33:33.723613 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:33.723160 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9" event={"ID":"2fbf11e6-0623-4072-915e-64b38a25a8b9","Type":"ContainerDied","Data":"27f1f955404ad8f1e22fa5cf4fb6bd302c05a353b4be55077340e45af6d3c7ea"} Jul 08 18:33:33.723613 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:33.723185 2574 scope.go:117] "RemoveContainer" containerID="fc355d1b021d551394b20e07ccbcb1d6713c29299a1bdaa15e1a908648a99b71" Jul 08 18:33:33.734685 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:33.734669 2574 scope.go:117] "RemoveContainer" containerID="fc355d1b021d551394b20e07ccbcb1d6713c29299a1bdaa15e1a908648a99b71" Jul 08 18:33:33.734944 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:33:33.734924 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc355d1b021d551394b20e07ccbcb1d6713c29299a1bdaa15e1a908648a99b71\": container with ID starting with fc355d1b021d551394b20e07ccbcb1d6713c29299a1bdaa15e1a908648a99b71 not found: ID does not exist" containerID="fc355d1b021d551394b20e07ccbcb1d6713c29299a1bdaa15e1a908648a99b71" Jul 08 18:33:33.735002 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:33.734956 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc355d1b021d551394b20e07ccbcb1d6713c29299a1bdaa15e1a908648a99b71"} err="failed to get container status \"fc355d1b021d551394b20e07ccbcb1d6713c29299a1bdaa15e1a908648a99b71\": rpc error: code = NotFound desc = could not find container \"fc355d1b021d551394b20e07ccbcb1d6713c29299a1bdaa15e1a908648a99b71\": container with ID starting with fc355d1b021d551394b20e07ccbcb1d6713c29299a1bdaa15e1a908648a99b71 not found: ID does not exist" Jul 08 18:33:33.748729 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:33.748705 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9"] Jul 08 18:33:33.753386 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:33.753367 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3ef261af-7fc4499c8d-nwxz9"] Jul 08 18:33:34.270653 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:33:34.270620 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fbf11e6-0623-4072-915e-64b38a25a8b9" path="/var/lib/kubelet/pods/2fbf11e6-0623-4072-915e-64b38a25a8b9/volumes" Jul 08 18:34:26.314403 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:34:26.314303 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9ftw_6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe/ovn-acl-logging/0.log" Jul 08 18:34:26.319844 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:34:26.319828 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9ftw_6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe/ovn-acl-logging/0.log" Jul 08 18:35:31.317696 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:31.317665 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8"] Jul 08 18:35:31.318182 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:31.317984 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fbf11e6-0623-4072-915e-64b38a25a8b9" containerName="maas-api" Jul 08 18:35:31.318182 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:31.317999 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fbf11e6-0623-4072-915e-64b38a25a8b9" containerName="maas-api" Jul 08 18:35:31.318182 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:31.318081 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fbf11e6-0623-4072-915e-64b38a25a8b9" containerName="maas-api" Jul 08 18:35:31.320555 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:31.320537 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" Jul 08 18:35:31.323276 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:31.323251 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-94205f-serving-cert\"" Jul 08 18:35:31.330528 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:31.330506 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8"] Jul 08 18:35:31.394314 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:31.394289 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb56a55-005c-4a31-ab35-4391cba89b4a-maas-api-tls\") pod \"maas-api-e2e-inf-a-94205f-bd689c894-b96s8\" (UID: \"8fb56a55-005c-4a31-ab35-4391cba89b4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" Jul 08 18:35:31.394424 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:31.394329 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h7lk\" (UniqueName: \"kubernetes.io/projected/8fb56a55-005c-4a31-ab35-4391cba89b4a-kube-api-access-2h7lk\") pod \"maas-api-e2e-inf-a-94205f-bd689c894-b96s8\" (UID: \"8fb56a55-005c-4a31-ab35-4391cba89b4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" Jul 08 18:35:31.394424 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:31.394417 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fb56a55-005c-4a31-ab35-4391cba89b4a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-94205f-bd689c894-b96s8\" (UID: \"8fb56a55-005c-4a31-ab35-4391cba89b4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" Jul 08 18:35:31.495479 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:31.495452 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fb56a55-005c-4a31-ab35-4391cba89b4a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-94205f-bd689c894-b96s8\" (UID: \"8fb56a55-005c-4a31-ab35-4391cba89b4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" Jul 08 18:35:31.495617 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:31.495563 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb56a55-005c-4a31-ab35-4391cba89b4a-maas-api-tls\") pod \"maas-api-e2e-inf-a-94205f-bd689c894-b96s8\" (UID: \"8fb56a55-005c-4a31-ab35-4391cba89b4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" Jul 08 18:35:31.495617 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:31.495593 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h7lk\" (UniqueName: \"kubernetes.io/projected/8fb56a55-005c-4a31-ab35-4391cba89b4a-kube-api-access-2h7lk\") pod \"maas-api-e2e-inf-a-94205f-bd689c894-b96s8\" (UID: \"8fb56a55-005c-4a31-ab35-4391cba89b4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" Jul 08 18:35:31.495728 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:35:31.495693 2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-serving-cert: secret "maas-api-e2e-inf-a-94205f-serving-cert" not found Jul 08 18:35:31.495784 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:35:31.495766 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fb56a55-005c-4a31-ab35-4391cba89b4a-maas-api-tls podName:8fb56a55-005c-4a31-ab35-4391cba89b4a nodeName:}" failed. No retries permitted until 2026-07-08 18:35:31.995749312 +0000 UTC m=+1866.239647454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8fb56a55-005c-4a31-ab35-4391cba89b4a-maas-api-tls") pod "maas-api-e2e-inf-a-94205f-bd689c894-b96s8" (UID: "8fb56a55-005c-4a31-ab35-4391cba89b4a") : secret "maas-api-e2e-inf-a-94205f-serving-cert" not found Jul 08 18:35:31.496110 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:31.496090 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fb56a55-005c-4a31-ab35-4391cba89b4a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-94205f-bd689c894-b96s8\" (UID: \"8fb56a55-005c-4a31-ab35-4391cba89b4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" Jul 08 18:35:31.504693 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:31.504671 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h7lk\" (UniqueName: \"kubernetes.io/projected/8fb56a55-005c-4a31-ab35-4391cba89b4a-kube-api-access-2h7lk\") pod \"maas-api-e2e-inf-a-94205f-bd689c894-b96s8\" (UID: \"8fb56a55-005c-4a31-ab35-4391cba89b4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" Jul 08 18:35:31.999353 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:31.999324 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb56a55-005c-4a31-ab35-4391cba89b4a-maas-api-tls\") pod \"maas-api-e2e-inf-a-94205f-bd689c894-b96s8\" (UID: \"8fb56a55-005c-4a31-ab35-4391cba89b4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" Jul 08 18:35:31.999545 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:35:31.999459 2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-serving-cert: secret "maas-api-e2e-inf-a-94205f-serving-cert" not found Jul 08 18:35:31.999545 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:35:31.999542 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fb56a55-005c-4a31-ab35-4391cba89b4a-maas-api-tls podName:8fb56a55-005c-4a31-ab35-4391cba89b4a nodeName:}" failed. No retries permitted until 2026-07-08 18:35:32.999523904 +0000 UTC m=+1867.243422061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8fb56a55-005c-4a31-ab35-4391cba89b4a-maas-api-tls") pod "maas-api-e2e-inf-a-94205f-bd689c894-b96s8" (UID: "8fb56a55-005c-4a31-ab35-4391cba89b4a") : secret "maas-api-e2e-inf-a-94205f-serving-cert" not found Jul 08 18:35:33.008708 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:33.008673 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb56a55-005c-4a31-ab35-4391cba89b4a-maas-api-tls\") pod \"maas-api-e2e-inf-a-94205f-bd689c894-b96s8\" (UID: \"8fb56a55-005c-4a31-ab35-4391cba89b4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" Jul 08 18:35:33.011261 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:33.011240 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb56a55-005c-4a31-ab35-4391cba89b4a-maas-api-tls\") pod \"maas-api-e2e-inf-a-94205f-bd689c894-b96s8\" (UID: \"8fb56a55-005c-4a31-ab35-4391cba89b4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" Jul 08 18:35:33.132574 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:33.132541 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" Jul 08 18:35:33.266195 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:33.266125 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8"] Jul 08 18:35:33.270355 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:35:33.270326 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fb56a55_005c_4a31_ab35_4391cba89b4a.slice/crio-d138d4eb4d55bc82234ea7373fa4704eb41cf2e7c235a39c9dad1567c77e8bb5 WatchSource:0}: Error finding container d138d4eb4d55bc82234ea7373fa4704eb41cf2e7c235a39c9dad1567c77e8bb5: Status 404 returned error can't find the container with id d138d4eb4d55bc82234ea7373fa4704eb41cf2e7c235a39c9dad1567c77e8bb5 Jul 08 18:35:33.272003 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:33.271988 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:35:33.341905 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:33.341873 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" event={"ID":"8fb56a55-005c-4a31-ab35-4391cba89b4a","Type":"ContainerStarted","Data":"d138d4eb4d55bc82234ea7373fa4704eb41cf2e7c235a39c9dad1567c77e8bb5"} Jul 08 18:35:34.349063 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:34.349003 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" event={"ID":"8fb56a55-005c-4a31-ab35-4391cba89b4a","Type":"ContainerStarted","Data":"b3412a01eec4cee90f38388c882569b814efb0beb85eb33d42c3b21eb2ce483b"} Jul 08 18:35:34.349460 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:34.349116 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" Jul 08 18:35:34.368735 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:34.368685 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" podStartSLOduration=2.806444564 podStartE2EDuration="3.368671614s" totalImagesPullingTime="562.22705ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:35:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:35:34.366436464 +0000 UTC m=+1868.610334629" watchObservedRunningTime="2026-07-08 18:35:34.368671614 +0000 UTC m=+1868.612569779" Jul 08 18:35:39.257262 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:39.257232 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29"] Jul 08 18:35:39.261008 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:39.260988 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" Jul 08 18:35:39.263709 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:39.263687 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-44b28a-serving-cert\"" Jul 08 18:35:39.272476 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:39.272454 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29"] Jul 08 18:35:39.360770 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:39.360745 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ccc3b86-4e7d-4b76-b493-f588266f77f5-maas-api-tls\") pod \"maas-api-e2e-inf-b-44b28a-678966cc78-x4n29\" (UID: \"4ccc3b86-4e7d-4b76-b493-f588266f77f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" Jul 08 18:35:39.360874 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:39.360790 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz9n4\" (UniqueName: \"kubernetes.io/projected/4ccc3b86-4e7d-4b76-b493-f588266f77f5-kube-api-access-bz9n4\") pod \"maas-api-e2e-inf-b-44b28a-678966cc78-x4n29\" (UID: \"4ccc3b86-4e7d-4b76-b493-f588266f77f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" Jul 08 18:35:39.360874 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:39.360838 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ccc3b86-4e7d-4b76-b493-f588266f77f5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-44b28a-678966cc78-x4n29\" (UID: \"4ccc3b86-4e7d-4b76-b493-f588266f77f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" Jul 08 18:35:39.461241 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:39.461216 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ccc3b86-4e7d-4b76-b493-f588266f77f5-maas-api-tls\") pod \"maas-api-e2e-inf-b-44b28a-678966cc78-x4n29\" (UID: \"4ccc3b86-4e7d-4b76-b493-f588266f77f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" Jul 08 18:35:39.461376 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:39.461247 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz9n4\" (UniqueName: \"kubernetes.io/projected/4ccc3b86-4e7d-4b76-b493-f588266f77f5-kube-api-access-bz9n4\") pod \"maas-api-e2e-inf-b-44b28a-678966cc78-x4n29\" (UID: \"4ccc3b86-4e7d-4b76-b493-f588266f77f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" Jul 08 18:35:39.461376 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:39.461290 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ccc3b86-4e7d-4b76-b493-f588266f77f5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-44b28a-678966cc78-x4n29\" (UID: \"4ccc3b86-4e7d-4b76-b493-f588266f77f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" Jul 08 18:35:39.461376 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:35:39.461358 2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-serving-cert: secret "maas-api-e2e-inf-b-44b28a-serving-cert" not found Jul 08 18:35:39.461483 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:35:39.461419 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ccc3b86-4e7d-4b76-b493-f588266f77f5-maas-api-tls podName:4ccc3b86-4e7d-4b76-b493-f588266f77f5 nodeName:}" failed. No retries permitted until 2026-07-08 18:35:39.961403208 +0000 UTC m=+1874.205301351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4ccc3b86-4e7d-4b76-b493-f588266f77f5-maas-api-tls") pod "maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" (UID: "4ccc3b86-4e7d-4b76-b493-f588266f77f5") : secret "maas-api-e2e-inf-b-44b28a-serving-cert" not found Jul 08 18:35:39.461923 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:39.461906 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ccc3b86-4e7d-4b76-b493-f588266f77f5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-44b28a-678966cc78-x4n29\" (UID: \"4ccc3b86-4e7d-4b76-b493-f588266f77f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" Jul 08 18:35:39.473348 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:39.473326 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz9n4\" (UniqueName: \"kubernetes.io/projected/4ccc3b86-4e7d-4b76-b493-f588266f77f5-kube-api-access-bz9n4\") pod \"maas-api-e2e-inf-b-44b28a-678966cc78-x4n29\" (UID: \"4ccc3b86-4e7d-4b76-b493-f588266f77f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" Jul 08 18:35:39.965951 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:39.965916 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ccc3b86-4e7d-4b76-b493-f588266f77f5-maas-api-tls\") pod \"maas-api-e2e-inf-b-44b28a-678966cc78-x4n29\" (UID: \"4ccc3b86-4e7d-4b76-b493-f588266f77f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" Jul 08 18:35:39.968631 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:39.968608 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ccc3b86-4e7d-4b76-b493-f588266f77f5-maas-api-tls\") pod \"maas-api-e2e-inf-b-44b28a-678966cc78-x4n29\" (UID: \"4ccc3b86-4e7d-4b76-b493-f588266f77f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" Jul 08 18:35:40.171783 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:40.171737 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" Jul 08 18:35:40.308393 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:40.308364 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29"] Jul 08 18:35:40.310226 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:35:40.310192 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ccc3b86_4e7d_4b76_b493_f588266f77f5.slice/crio-150a07498dab15f3d8df0220fab4f82ebdbfc0cc59a1b7caa957ba08ed158ad3 WatchSource:0}: Error finding container 150a07498dab15f3d8df0220fab4f82ebdbfc0cc59a1b7caa957ba08ed158ad3: Status 404 returned error can't find the container with id 150a07498dab15f3d8df0220fab4f82ebdbfc0cc59a1b7caa957ba08ed158ad3 Jul 08 18:35:40.360245 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:40.360219 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" Jul 08 18:35:40.384608 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:40.384583 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" event={"ID":"4ccc3b86-4e7d-4b76-b493-f588266f77f5","Type":"ContainerStarted","Data":"150a07498dab15f3d8df0220fab4f82ebdbfc0cc59a1b7caa957ba08ed158ad3"} Jul 08 18:35:41.391645 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:41.391568 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" event={"ID":"4ccc3b86-4e7d-4b76-b493-f588266f77f5","Type":"ContainerStarted","Data":"f78ecd41d3bd563e4f4eac30521fcb0857f5cab8b5a862639abfbed59fda7ee2"} Jul 08 18:35:41.392097 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:41.391676 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" Jul 08 18:35:41.412475 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:41.412433 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" podStartSLOduration=1.753870789 podStartE2EDuration="2.412418791s" totalImagesPullingTime="658.548002ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:35:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:35:41.409435734 +0000 UTC m=+1875.653333930" watchObservedRunningTime="2026-07-08 18:35:41.412418791 +0000 UTC m=+1875.656316956" Jul 08 18:35:47.401713 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:35:47.401684 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" Jul 08 18:36:59.628335 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:36:59.628292 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8"] Jul 08 18:36:59.628866 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:36:59.628630 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" podUID="8fb56a55-005c-4a31-ab35-4391cba89b4a" containerName="maas-api" containerID="cri-o://b3412a01eec4cee90f38388c882569b814efb0beb85eb33d42c3b21eb2ce483b" gracePeriod=30 Jul 08 18:36:59.784192 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:36:59.784159 2574 generic.go:356] "Generic (PLEG): container finished" podID="8fb56a55-005c-4a31-ab35-4391cba89b4a" containerID="b3412a01eec4cee90f38388c882569b814efb0beb85eb33d42c3b21eb2ce483b" exitCode=0 Jul 08 18:36:59.784369 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:36:59.784226 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" event={"ID":"8fb56a55-005c-4a31-ab35-4391cba89b4a","Type":"ContainerDied","Data":"b3412a01eec4cee90f38388c882569b814efb0beb85eb33d42c3b21eb2ce483b"} Jul 08 18:36:59.882930 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:36:59.882872 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" Jul 08 18:36:59.983637 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:36:59.983603 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fb56a55-005c-4a31-ab35-4391cba89b4a-openshift-service-ca\") pod \"8fb56a55-005c-4a31-ab35-4391cba89b4a\" (UID: \"8fb56a55-005c-4a31-ab35-4391cba89b4a\") " Jul 08 18:36:59.983807 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:36:59.983659 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb56a55-005c-4a31-ab35-4391cba89b4a-maas-api-tls\") pod \"8fb56a55-005c-4a31-ab35-4391cba89b4a\" (UID: \"8fb56a55-005c-4a31-ab35-4391cba89b4a\") " Jul 08 18:36:59.983807 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:36:59.983697 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h7lk\" (UniqueName: \"kubernetes.io/projected/8fb56a55-005c-4a31-ab35-4391cba89b4a-kube-api-access-2h7lk\") pod \"8fb56a55-005c-4a31-ab35-4391cba89b4a\" (UID: \"8fb56a55-005c-4a31-ab35-4391cba89b4a\") " Jul 08 18:36:59.983964 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:36:59.983937 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fb56a55-005c-4a31-ab35-4391cba89b4a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8fb56a55-005c-4a31-ab35-4391cba89b4a" (UID: "8fb56a55-005c-4a31-ab35-4391cba89b4a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:36:59.985876 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:36:59.985845 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fb56a55-005c-4a31-ab35-4391cba89b4a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8fb56a55-005c-4a31-ab35-4391cba89b4a" (UID: "8fb56a55-005c-4a31-ab35-4391cba89b4a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:36:59.986005 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:36:59.985947 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fb56a55-005c-4a31-ab35-4391cba89b4a-kube-api-access-2h7lk" (OuterVolumeSpecName: "kube-api-access-2h7lk") pod "8fb56a55-005c-4a31-ab35-4391cba89b4a" (UID: "8fb56a55-005c-4a31-ab35-4391cba89b4a"). InnerVolumeSpecName "kube-api-access-2h7lk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:37:00.084871 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:00.084842 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fb56a55-005c-4a31-ab35-4391cba89b4a-openshift-service-ca\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:37:00.084871 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:00.084867 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb56a55-005c-4a31-ab35-4391cba89b4a-maas-api-tls\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:37:00.085049 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:00.084881 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2h7lk\" (UniqueName: \"kubernetes.io/projected/8fb56a55-005c-4a31-ab35-4391cba89b4a-kube-api-access-2h7lk\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:37:00.790045 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:00.790002 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" Jul 08 18:37:00.790505 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:00.790053 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8" event={"ID":"8fb56a55-005c-4a31-ab35-4391cba89b4a","Type":"ContainerDied","Data":"d138d4eb4d55bc82234ea7373fa4704eb41cf2e7c235a39c9dad1567c77e8bb5"} Jul 08 18:37:00.790505 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:00.790118 2574 scope.go:117] "RemoveContainer" containerID="b3412a01eec4cee90f38388c882569b814efb0beb85eb33d42c3b21eb2ce483b" Jul 08 18:37:00.807055 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:00.807017 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8"] Jul 08 18:37:00.810105 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:00.810083 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-94205f-bd689c894-b96s8"] Jul 08 18:37:02.270916 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:02.270882 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fb56a55-005c-4a31-ab35-4391cba89b4a" path="/var/lib/kubelet/pods/8fb56a55-005c-4a31-ab35-4391cba89b4a/volumes" Jul 08 18:37:42.729919 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:42.729886 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29"] Jul 08 18:37:42.730805 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:42.730170 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" podUID="4ccc3b86-4e7d-4b76-b493-f588266f77f5" containerName="maas-api" containerID="cri-o://f78ecd41d3bd563e4f4eac30521fcb0857f5cab8b5a862639abfbed59fda7ee2" gracePeriod=30 Jul 08 18:37:42.970886 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:42.970857 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" Jul 08 18:37:43.012700 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:43.012640 2574 generic.go:356] "Generic (PLEG): container finished" podID="4ccc3b86-4e7d-4b76-b493-f588266f77f5" containerID="f78ecd41d3bd563e4f4eac30521fcb0857f5cab8b5a862639abfbed59fda7ee2" exitCode=0 Jul 08 18:37:43.012700 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:43.012680 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" Jul 08 18:37:43.012897 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:43.012732 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" event={"ID":"4ccc3b86-4e7d-4b76-b493-f588266f77f5","Type":"ContainerDied","Data":"f78ecd41d3bd563e4f4eac30521fcb0857f5cab8b5a862639abfbed59fda7ee2"} Jul 08 18:37:43.012897 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:43.012785 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29" event={"ID":"4ccc3b86-4e7d-4b76-b493-f588266f77f5","Type":"ContainerDied","Data":"150a07498dab15f3d8df0220fab4f82ebdbfc0cc59a1b7caa957ba08ed158ad3"} Jul 08 18:37:43.012897 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:43.012814 2574 scope.go:117] "RemoveContainer" containerID="f78ecd41d3bd563e4f4eac30521fcb0857f5cab8b5a862639abfbed59fda7ee2" Jul 08 18:37:43.022599 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:43.022583 2574 scope.go:117] "RemoveContainer" containerID="f78ecd41d3bd563e4f4eac30521fcb0857f5cab8b5a862639abfbed59fda7ee2" Jul 08 18:37:43.022858 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:37:43.022839 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f78ecd41d3bd563e4f4eac30521fcb0857f5cab8b5a862639abfbed59fda7ee2\": container with ID starting with f78ecd41d3bd563e4f4eac30521fcb0857f5cab8b5a862639abfbed59fda7ee2 not found: ID does not exist" containerID="f78ecd41d3bd563e4f4eac30521fcb0857f5cab8b5a862639abfbed59fda7ee2" Jul 08 18:37:43.022919 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:43.022871 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f78ecd41d3bd563e4f4eac30521fcb0857f5cab8b5a862639abfbed59fda7ee2"} err="failed to get container status \"f78ecd41d3bd563e4f4eac30521fcb0857f5cab8b5a862639abfbed59fda7ee2\": rpc error: code = NotFound desc = could not find container \"f78ecd41d3bd563e4f4eac30521fcb0857f5cab8b5a862639abfbed59fda7ee2\": container with ID starting with f78ecd41d3bd563e4f4eac30521fcb0857f5cab8b5a862639abfbed59fda7ee2 not found: ID does not exist" Jul 08 18:37:43.101798 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:43.101768 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ccc3b86-4e7d-4b76-b493-f588266f77f5-maas-api-tls\") pod \"4ccc3b86-4e7d-4b76-b493-f588266f77f5\" (UID: \"4ccc3b86-4e7d-4b76-b493-f588266f77f5\") " Jul 08 18:37:43.101912 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:43.101840 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz9n4\" (UniqueName: \"kubernetes.io/projected/4ccc3b86-4e7d-4b76-b493-f588266f77f5-kube-api-access-bz9n4\") pod \"4ccc3b86-4e7d-4b76-b493-f588266f77f5\" (UID: \"4ccc3b86-4e7d-4b76-b493-f588266f77f5\") " Jul 08 18:37:43.101974 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:43.101927 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ccc3b86-4e7d-4b76-b493-f588266f77f5-openshift-service-ca\") pod \"4ccc3b86-4e7d-4b76-b493-f588266f77f5\" (UID: \"4ccc3b86-4e7d-4b76-b493-f588266f77f5\") " Jul 08 18:37:43.102320 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:43.102277 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ccc3b86-4e7d-4b76-b493-f588266f77f5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4ccc3b86-4e7d-4b76-b493-f588266f77f5" (UID: "4ccc3b86-4e7d-4b76-b493-f588266f77f5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:37:43.103830 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:43.103806 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ccc3b86-4e7d-4b76-b493-f588266f77f5-kube-api-access-bz9n4" (OuterVolumeSpecName: "kube-api-access-bz9n4") pod "4ccc3b86-4e7d-4b76-b493-f588266f77f5" (UID: "4ccc3b86-4e7d-4b76-b493-f588266f77f5"). InnerVolumeSpecName "kube-api-access-bz9n4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:37:43.103901 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:43.103884 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ccc3b86-4e7d-4b76-b493-f588266f77f5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4ccc3b86-4e7d-4b76-b493-f588266f77f5" (UID: "4ccc3b86-4e7d-4b76-b493-f588266f77f5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:37:43.203220 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:43.203198 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ccc3b86-4e7d-4b76-b493-f588266f77f5-openshift-service-ca\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:37:43.203304 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:43.203223 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ccc3b86-4e7d-4b76-b493-f588266f77f5-maas-api-tls\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:37:43.203304 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:43.203235 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz9n4\" (UniqueName: \"kubernetes.io/projected/4ccc3b86-4e7d-4b76-b493-f588266f77f5-kube-api-access-bz9n4\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:37:43.335156 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:43.335127 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29"] Jul 08 18:37:43.342466 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:43.342444 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-44b28a-678966cc78-x4n29"] Jul 08 18:37:44.270323 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:44.270287 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ccc3b86-4e7d-4b76-b493-f588266f77f5" path="/var/lib/kubelet/pods/4ccc3b86-4e7d-4b76-b493-f588266f77f5/volumes" Jul 08 18:37:52.985882 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:52.985852 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h"] Jul 08 18:37:52.986364 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:52.986170 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fb56a55-005c-4a31-ab35-4391cba89b4a" containerName="maas-api" Jul 08 18:37:52.986364 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:52.986182 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fb56a55-005c-4a31-ab35-4391cba89b4a" containerName="maas-api" Jul 08 18:37:52.986364 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:52.986190 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ccc3b86-4e7d-4b76-b493-f588266f77f5" containerName="maas-api" Jul 08 18:37:52.986364 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:52.986196 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ccc3b86-4e7d-4b76-b493-f588266f77f5" containerName="maas-api" Jul 08 18:37:52.986364 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:52.986248 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ccc3b86-4e7d-4b76-b493-f588266f77f5" containerName="maas-api" Jul 08 18:37:52.986364 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:52.986257 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fb56a55-005c-4a31-ab35-4391cba89b4a" containerName="maas-api" Jul 08 18:37:52.990429 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:52.990410 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" Jul 08 18:37:52.993141 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:52.993119 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-34c6f7-serving-cert\"" Jul 08 18:37:53.002047 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:53.002007 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h"] Jul 08 18:37:53.077072 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:53.077041 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-maas-api-tls\") pod \"maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h\" (UID: \"a332bb06-9795-4e5e-b1b9-86a4bb03c79d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" Jul 08 18:37:53.077291 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:53.077272 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdk5h\" (UniqueName: \"kubernetes.io/projected/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-kube-api-access-kdk5h\") pod \"maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h\" (UID: \"a332bb06-9795-4e5e-b1b9-86a4bb03c79d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" Jul 08 18:37:53.077490 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:53.077451 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-openshift-service-ca\") pod \"maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h\" (UID: \"a332bb06-9795-4e5e-b1b9-86a4bb03c79d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" Jul 08 18:37:53.178638 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:53.178613 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-openshift-service-ca\") pod \"maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h\" (UID: \"a332bb06-9795-4e5e-b1b9-86a4bb03c79d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" Jul 08 18:37:53.178756 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:53.178661 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-maas-api-tls\") pod \"maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h\" (UID: \"a332bb06-9795-4e5e-b1b9-86a4bb03c79d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" Jul 08 18:37:53.178756 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:53.178685 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdk5h\" (UniqueName: \"kubernetes.io/projected/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-kube-api-access-kdk5h\") pod \"maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h\" (UID: \"a332bb06-9795-4e5e-b1b9-86a4bb03c79d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" Jul 08 18:37:53.178833 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:37:53.178783 2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-serving-cert: secret "maas-api-e2e-api-a-34c6f7-serving-cert" not found Jul 08 18:37:53.178884 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:37:53.178873 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-maas-api-tls podName:a332bb06-9795-4e5e-b1b9-86a4bb03c79d nodeName:}" failed. No retries permitted until 2026-07-08 18:37:53.678852515 +0000 UTC m=+2007.922750663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-maas-api-tls") pod "maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" (UID: "a332bb06-9795-4e5e-b1b9-86a4bb03c79d") : secret "maas-api-e2e-api-a-34c6f7-serving-cert" not found Jul 08 18:37:53.179411 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:53.179394 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-openshift-service-ca\") pod \"maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h\" (UID: \"a332bb06-9795-4e5e-b1b9-86a4bb03c79d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" Jul 08 18:37:53.188399 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:53.188374 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdk5h\" (UniqueName: \"kubernetes.io/projected/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-kube-api-access-kdk5h\") pod \"maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h\" (UID: \"a332bb06-9795-4e5e-b1b9-86a4bb03c79d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" Jul 08 18:37:53.681706 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:53.681668 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-maas-api-tls\") pod \"maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h\" (UID: \"a332bb06-9795-4e5e-b1b9-86a4bb03c79d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" Jul 08 18:37:53.684285 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:53.684262 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-maas-api-tls\") pod \"maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h\" (UID: \"a332bb06-9795-4e5e-b1b9-86a4bb03c79d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" Jul 08 18:37:53.899938 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:53.899906 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" Jul 08 18:37:54.040820 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:54.040793 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h"] Jul 08 18:37:54.042866 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:37:54.042842 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda332bb06_9795_4e5e_b1b9_86a4bb03c79d.slice/crio-413344c09aff6816cbda0c0997c82075a39f595e1a8dc3b22480e310c53706b0 WatchSource:0}: Error finding container 413344c09aff6816cbda0c0997c82075a39f595e1a8dc3b22480e310c53706b0: Status 404 returned error can't find the container with id 413344c09aff6816cbda0c0997c82075a39f595e1a8dc3b22480e310c53706b0 Jul 08 18:37:54.070547 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:54.070517 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" event={"ID":"a332bb06-9795-4e5e-b1b9-86a4bb03c79d","Type":"ContainerStarted","Data":"413344c09aff6816cbda0c0997c82075a39f595e1a8dc3b22480e310c53706b0"} Jul 08 18:37:55.077421 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:55.077344 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" event={"ID":"a332bb06-9795-4e5e-b1b9-86a4bb03c79d","Type":"ContainerStarted","Data":"bcaaccdc53f2890fd1ad0c64378c703a97c4321f21dd5137ead54d5f5205b9e7"} Jul 08 18:37:55.077421 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:55.077408 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" Jul 08 18:37:55.096835 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:37:55.096760 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" podStartSLOduration=2.435148447 podStartE2EDuration="3.096742509s" totalImagesPullingTime="661.594062ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:37:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:37:55.095820739 +0000 UTC m=+2009.339718904" watchObservedRunningTime="2026-07-08 18:37:55.096742509 +0000 UTC m=+2009.340640676" Jul 08 18:38:01.085127 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:01.085095 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4"] Jul 08 18:38:01.088545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:01.088520 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" Jul 08 18:38:01.088672 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:01.088587 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" Jul 08 18:38:01.090955 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:01.090933 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-3689d4-serving-cert\"" Jul 08 18:38:01.100012 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:01.099982 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4"] Jul 08 18:38:01.139797 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:01.139769 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5de12192-71b8-4627-a4c7-fa5beae83a37-maas-api-tls\") pod \"maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4\" (UID: \"5de12192-71b8-4627-a4c7-fa5beae83a37\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" Jul 08 18:38:01.139965 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:01.139812 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5de12192-71b8-4627-a4c7-fa5beae83a37-openshift-service-ca\") pod \"maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4\" (UID: \"5de12192-71b8-4627-a4c7-fa5beae83a37\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" Jul 08 18:38:01.139965 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:01.139843 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hnhf\" (UniqueName: \"kubernetes.io/projected/5de12192-71b8-4627-a4c7-fa5beae83a37-kube-api-access-2hnhf\") pod \"maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4\" (UID: \"5de12192-71b8-4627-a4c7-fa5beae83a37\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" Jul 08 18:38:01.241240 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:01.241209 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5de12192-71b8-4627-a4c7-fa5beae83a37-maas-api-tls\") pod \"maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4\" (UID: \"5de12192-71b8-4627-a4c7-fa5beae83a37\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" Jul 08 18:38:01.241401 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:01.241246 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5de12192-71b8-4627-a4c7-fa5beae83a37-openshift-service-ca\") pod \"maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4\" (UID: \"5de12192-71b8-4627-a4c7-fa5beae83a37\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" Jul 08 18:38:01.241401 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:01.241267 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hnhf\" (UniqueName: \"kubernetes.io/projected/5de12192-71b8-4627-a4c7-fa5beae83a37-kube-api-access-2hnhf\") pod \"maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4\" (UID: \"5de12192-71b8-4627-a4c7-fa5beae83a37\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" Jul 08 18:38:01.241894 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:01.241869 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5de12192-71b8-4627-a4c7-fa5beae83a37-openshift-service-ca\") pod \"maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4\" (UID: \"5de12192-71b8-4627-a4c7-fa5beae83a37\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" Jul 08 18:38:01.243828 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:01.243798 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5de12192-71b8-4627-a4c7-fa5beae83a37-maas-api-tls\") pod \"maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4\" (UID: \"5de12192-71b8-4627-a4c7-fa5beae83a37\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" Jul 08 18:38:01.250191 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:01.250165 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hnhf\" (UniqueName: \"kubernetes.io/projected/5de12192-71b8-4627-a4c7-fa5beae83a37-kube-api-access-2hnhf\") pod \"maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4\" (UID: \"5de12192-71b8-4627-a4c7-fa5beae83a37\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" Jul 08 18:38:01.400792 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:01.400716 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" Jul 08 18:38:01.534329 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:01.534304 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4"] Jul 08 18:38:01.536272 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:38:01.536247 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5de12192_71b8_4627_a4c7_fa5beae83a37.slice/crio-6c3b2e7d7475bcc1874be2417343c4c7c0f31ad7a9830adf7ff9d791b4648120 WatchSource:0}: Error finding container 6c3b2e7d7475bcc1874be2417343c4c7c0f31ad7a9830adf7ff9d791b4648120: Status 404 returned error can't find the container with id 6c3b2e7d7475bcc1874be2417343c4c7c0f31ad7a9830adf7ff9d791b4648120 Jul 08 18:38:02.114214 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:02.114177 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" event={"ID":"5de12192-71b8-4627-a4c7-fa5beae83a37","Type":"ContainerStarted","Data":"ee0939133d1cf7a7c9be03deb0ff505da9d0ae82d28c1cf95c41aea507de654a"} Jul 08 18:38:02.114642 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:02.114240 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" event={"ID":"5de12192-71b8-4627-a4c7-fa5beae83a37","Type":"ContainerStarted","Data":"6c3b2e7d7475bcc1874be2417343c4c7c0f31ad7a9830adf7ff9d791b4648120"} Jul 08 18:38:02.114642 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:02.114303 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" Jul 08 18:38:02.133836 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:02.133727 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" podStartSLOduration=0.797908752 podStartE2EDuration="1.133709561s" totalImagesPullingTime="335.800809ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:38:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:38:02.132467385 +0000 UTC m=+2016.376365546" watchObservedRunningTime="2026-07-08 18:38:02.133709561 +0000 UTC m=+2016.377607726" Jul 08 18:38:08.124882 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:08.124854 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" Jul 08 18:38:14.602857 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:14.602819 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h"] Jul 08 18:38:14.603348 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:14.603197 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" podUID="a332bb06-9795-4e5e-b1b9-86a4bb03c79d" containerName="maas-api" containerID="cri-o://bcaaccdc53f2890fd1ad0c64378c703a97c4321f21dd5137ead54d5f5205b9e7" gracePeriod=30 Jul 08 18:38:14.854067 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:14.853998 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" Jul 08 18:38:14.959080 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:14.959041 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdk5h\" (UniqueName: \"kubernetes.io/projected/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-kube-api-access-kdk5h\") pod \"a332bb06-9795-4e5e-b1b9-86a4bb03c79d\" (UID: \"a332bb06-9795-4e5e-b1b9-86a4bb03c79d\") " Jul 08 18:38:14.959215 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:14.959101 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-openshift-service-ca\") pod \"a332bb06-9795-4e5e-b1b9-86a4bb03c79d\" (UID: \"a332bb06-9795-4e5e-b1b9-86a4bb03c79d\") " Jul 08 18:38:14.959215 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:14.959142 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-maas-api-tls\") pod \"a332bb06-9795-4e5e-b1b9-86a4bb03c79d\" (UID: \"a332bb06-9795-4e5e-b1b9-86a4bb03c79d\") " Jul 08 18:38:14.959556 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:14.959523 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a332bb06-9795-4e5e-b1b9-86a4bb03c79d" (UID: "a332bb06-9795-4e5e-b1b9-86a4bb03c79d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:38:14.961309 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:14.961273 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-kube-api-access-kdk5h" (OuterVolumeSpecName: "kube-api-access-kdk5h") pod "a332bb06-9795-4e5e-b1b9-86a4bb03c79d" (UID: "a332bb06-9795-4e5e-b1b9-86a4bb03c79d"). InnerVolumeSpecName "kube-api-access-kdk5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:38:14.961462 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:14.961314 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a332bb06-9795-4e5e-b1b9-86a4bb03c79d" (UID: "a332bb06-9795-4e5e-b1b9-86a4bb03c79d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:38:15.060451 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:15.060424 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdk5h\" (UniqueName: \"kubernetes.io/projected/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-kube-api-access-kdk5h\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:38:15.060451 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:15.060446 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-openshift-service-ca\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:38:15.060451 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:15.060455 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a332bb06-9795-4e5e-b1b9-86a4bb03c79d-maas-api-tls\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:38:15.181758 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:15.181732 2574 generic.go:356] "Generic (PLEG): container finished" podID="a332bb06-9795-4e5e-b1b9-86a4bb03c79d" containerID="bcaaccdc53f2890fd1ad0c64378c703a97c4321f21dd5137ead54d5f5205b9e7" exitCode=0 Jul 08 18:38:15.181904 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:15.181789 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" Jul 08 18:38:15.181904 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:15.181820 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" event={"ID":"a332bb06-9795-4e5e-b1b9-86a4bb03c79d","Type":"ContainerDied","Data":"bcaaccdc53f2890fd1ad0c64378c703a97c4321f21dd5137ead54d5f5205b9e7"} Jul 08 18:38:15.181904 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:15.181890 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h" event={"ID":"a332bb06-9795-4e5e-b1b9-86a4bb03c79d","Type":"ContainerDied","Data":"413344c09aff6816cbda0c0997c82075a39f595e1a8dc3b22480e310c53706b0"} Jul 08 18:38:15.182063 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:15.181913 2574 scope.go:117] "RemoveContainer" containerID="bcaaccdc53f2890fd1ad0c64378c703a97c4321f21dd5137ead54d5f5205b9e7" Jul 08 18:38:15.191178 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:15.191164 2574 scope.go:117] "RemoveContainer" containerID="bcaaccdc53f2890fd1ad0c64378c703a97c4321f21dd5137ead54d5f5205b9e7" Jul 08 18:38:15.191434 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:38:15.191416 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcaaccdc53f2890fd1ad0c64378c703a97c4321f21dd5137ead54d5f5205b9e7\": container with ID starting with bcaaccdc53f2890fd1ad0c64378c703a97c4321f21dd5137ead54d5f5205b9e7 not found: ID does not exist" containerID="bcaaccdc53f2890fd1ad0c64378c703a97c4321f21dd5137ead54d5f5205b9e7" Jul 08 18:38:15.191480 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:15.191441 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcaaccdc53f2890fd1ad0c64378c703a97c4321f21dd5137ead54d5f5205b9e7"} err="failed to get container status \"bcaaccdc53f2890fd1ad0c64378c703a97c4321f21dd5137ead54d5f5205b9e7\": rpc error: code = NotFound desc = could not find container \"bcaaccdc53f2890fd1ad0c64378c703a97c4321f21dd5137ead54d5f5205b9e7\": container with ID starting with bcaaccdc53f2890fd1ad0c64378c703a97c4321f21dd5137ead54d5f5205b9e7 not found: ID does not exist" Jul 08 18:38:15.203056 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:15.203015 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h"] Jul 08 18:38:15.207271 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:15.207252 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-34c6f7-776d46555d-ctx2h"] Jul 08 18:38:16.271575 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:16.271541 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a332bb06-9795-4e5e-b1b9-86a4bb03c79d" path="/var/lib/kubelet/pods/a332bb06-9795-4e5e-b1b9-86a4bb03c79d/volumes" Jul 08 18:38:21.732744 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:21.732704 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4"] Jul 08 18:38:21.733170 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:21.733017 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" podUID="5de12192-71b8-4627-a4c7-fa5beae83a37" containerName="maas-api" containerID="cri-o://ee0939133d1cf7a7c9be03deb0ff505da9d0ae82d28c1cf95c41aea507de654a" gracePeriod=30 Jul 08 18:38:21.974888 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:21.974866 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" Jul 08 18:38:22.113503 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:22.113443 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5de12192-71b8-4627-a4c7-fa5beae83a37-maas-api-tls\") pod \"5de12192-71b8-4627-a4c7-fa5beae83a37\" (UID: \"5de12192-71b8-4627-a4c7-fa5beae83a37\") " Jul 08 18:38:22.113503 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:22.113482 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hnhf\" (UniqueName: \"kubernetes.io/projected/5de12192-71b8-4627-a4c7-fa5beae83a37-kube-api-access-2hnhf\") pod \"5de12192-71b8-4627-a4c7-fa5beae83a37\" (UID: \"5de12192-71b8-4627-a4c7-fa5beae83a37\") " Jul 08 18:38:22.113690 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:22.113520 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5de12192-71b8-4627-a4c7-fa5beae83a37-openshift-service-ca\") pod \"5de12192-71b8-4627-a4c7-fa5beae83a37\" (UID: \"5de12192-71b8-4627-a4c7-fa5beae83a37\") " Jul 08 18:38:22.113839 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:22.113816 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5de12192-71b8-4627-a4c7-fa5beae83a37-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5de12192-71b8-4627-a4c7-fa5beae83a37" (UID: "5de12192-71b8-4627-a4c7-fa5beae83a37"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:38:22.115703 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:22.115671 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5de12192-71b8-4627-a4c7-fa5beae83a37-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5de12192-71b8-4627-a4c7-fa5beae83a37" (UID: "5de12192-71b8-4627-a4c7-fa5beae83a37"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:38:22.115703 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:22.115685 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5de12192-71b8-4627-a4c7-fa5beae83a37-kube-api-access-2hnhf" (OuterVolumeSpecName: "kube-api-access-2hnhf") pod "5de12192-71b8-4627-a4c7-fa5beae83a37" (UID: "5de12192-71b8-4627-a4c7-fa5beae83a37"). InnerVolumeSpecName "kube-api-access-2hnhf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:38:22.214038 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:22.214009 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5de12192-71b8-4627-a4c7-fa5beae83a37-maas-api-tls\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:38:22.214156 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:22.214051 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hnhf\" (UniqueName: \"kubernetes.io/projected/5de12192-71b8-4627-a4c7-fa5beae83a37-kube-api-access-2hnhf\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:38:22.214156 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:22.214061 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5de12192-71b8-4627-a4c7-fa5beae83a37-openshift-service-ca\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:38:22.217437 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:22.217412 2574 generic.go:356] "Generic (PLEG): container finished" podID="5de12192-71b8-4627-a4c7-fa5beae83a37" containerID="ee0939133d1cf7a7c9be03deb0ff505da9d0ae82d28c1cf95c41aea507de654a" exitCode=0 Jul 08 18:38:22.217537 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:22.217457 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" Jul 08 18:38:22.217537 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:22.217498 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" event={"ID":"5de12192-71b8-4627-a4c7-fa5beae83a37","Type":"ContainerDied","Data":"ee0939133d1cf7a7c9be03deb0ff505da9d0ae82d28c1cf95c41aea507de654a"} Jul 08 18:38:22.217611 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:22.217550 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4" event={"ID":"5de12192-71b8-4627-a4c7-fa5beae83a37","Type":"ContainerDied","Data":"6c3b2e7d7475bcc1874be2417343c4c7c0f31ad7a9830adf7ff9d791b4648120"} Jul 08 18:38:22.217611 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:22.217573 2574 scope.go:117] "RemoveContainer" containerID="ee0939133d1cf7a7c9be03deb0ff505da9d0ae82d28c1cf95c41aea507de654a" Jul 08 18:38:22.226212 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:22.226196 2574 scope.go:117] "RemoveContainer" containerID="ee0939133d1cf7a7c9be03deb0ff505da9d0ae82d28c1cf95c41aea507de654a" Jul 08 18:38:22.226475 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:38:22.226456 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee0939133d1cf7a7c9be03deb0ff505da9d0ae82d28c1cf95c41aea507de654a\": container with ID starting with ee0939133d1cf7a7c9be03deb0ff505da9d0ae82d28c1cf95c41aea507de654a not found: ID does not exist" containerID="ee0939133d1cf7a7c9be03deb0ff505da9d0ae82d28c1cf95c41aea507de654a" Jul 08 18:38:22.226545 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:22.226483 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee0939133d1cf7a7c9be03deb0ff505da9d0ae82d28c1cf95c41aea507de654a"} err="failed to get container status \"ee0939133d1cf7a7c9be03deb0ff505da9d0ae82d28c1cf95c41aea507de654a\": rpc error: code = NotFound desc = could not find container \"ee0939133d1cf7a7c9be03deb0ff505da9d0ae82d28c1cf95c41aea507de654a\": container with ID starting with ee0939133d1cf7a7c9be03deb0ff505da9d0ae82d28c1cf95c41aea507de654a not found: ID does not exist" Jul 08 18:38:22.238994 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:22.238974 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4"] Jul 08 18:38:22.242828 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:22.242801 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3689d4-775cf5dc8-tqgk4"] Jul 08 18:38:22.271067 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:22.271043 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5de12192-71b8-4627-a4c7-fa5beae83a37" path="/var/lib/kubelet/pods/5de12192-71b8-4627-a4c7-fa5beae83a37/volumes" Jul 08 18:38:32.286767 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:32.286734 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f"] Jul 08 18:38:32.287260 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:32.287075 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5de12192-71b8-4627-a4c7-fa5beae83a37" containerName="maas-api" Jul 08 18:38:32.287260 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:32.287088 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5de12192-71b8-4627-a4c7-fa5beae83a37" containerName="maas-api" Jul 08 18:38:32.287260 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:32.287099 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a332bb06-9795-4e5e-b1b9-86a4bb03c79d" containerName="maas-api" Jul 08 18:38:32.287260 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:32.287105 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a332bb06-9795-4e5e-b1b9-86a4bb03c79d" containerName="maas-api" Jul 08 18:38:32.287260 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:32.287176 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a332bb06-9795-4e5e-b1b9-86a4bb03c79d" containerName="maas-api" Jul 08 18:38:32.287260 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:32.287184 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5de12192-71b8-4627-a4c7-fa5beae83a37" containerName="maas-api" Jul 08 18:38:32.289904 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:32.289880 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" Jul 08 18:38:32.292556 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:32.292536 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-deca3c-serving-cert\"" Jul 08 18:38:32.301686 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:32.301649 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f"] Jul 08 18:38:32.399299 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:32.399266 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-maas-api-tls\") pod \"maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f\" (UID: \"8a3e6148-dee9-4bfc-8d43-e504b6455f3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" Jul 08 18:38:32.399458 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:32.399308 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmj4s\" (UniqueName: \"kubernetes.io/projected/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-kube-api-access-fmj4s\") pod \"maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f\" (UID: \"8a3e6148-dee9-4bfc-8d43-e504b6455f3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" Jul 08 18:38:32.399501 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:32.399454 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f\" (UID: \"8a3e6148-dee9-4bfc-8d43-e504b6455f3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" Jul 08 18:38:32.500901 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:32.500872 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-maas-api-tls\") pod \"maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f\" (UID: \"8a3e6148-dee9-4bfc-8d43-e504b6455f3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" Jul 08 18:38:32.501082 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:32.500909 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmj4s\" (UniqueName: \"kubernetes.io/projected/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-kube-api-access-fmj4s\") pod \"maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f\" (UID: \"8a3e6148-dee9-4bfc-8d43-e504b6455f3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" Jul 08 18:38:32.501082 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:32.500976 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f\" (UID: \"8a3e6148-dee9-4bfc-8d43-e504b6455f3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" Jul 08 18:38:32.501082 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:38:32.501014 2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-serving-cert: secret "maas-api-e2e-shared-a-deca3c-serving-cert" not found Jul 08 18:38:32.501200 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:38:32.501114 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-maas-api-tls podName:8a3e6148-dee9-4bfc-8d43-e504b6455f3f nodeName:}" failed. No retries permitted until 2026-07-08 18:38:33.001094487 +0000 UTC m=+2047.244992630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-maas-api-tls") pod "maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" (UID: "8a3e6148-dee9-4bfc-8d43-e504b6455f3f") : secret "maas-api-e2e-shared-a-deca3c-serving-cert" not found Jul 08 18:38:32.501599 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:32.501583 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f\" (UID: \"8a3e6148-dee9-4bfc-8d43-e504b6455f3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" Jul 08 18:38:32.511535 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:32.511503 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmj4s\" (UniqueName: \"kubernetes.io/projected/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-kube-api-access-fmj4s\") pod \"maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f\" (UID: \"8a3e6148-dee9-4bfc-8d43-e504b6455f3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" Jul 08 18:38:33.005633 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:33.005604 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-maas-api-tls\") pod \"maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f\" (UID: \"8a3e6148-dee9-4bfc-8d43-e504b6455f3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" Jul 08 18:38:33.008171 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:33.008147 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-maas-api-tls\") pod \"maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f\" (UID: \"8a3e6148-dee9-4bfc-8d43-e504b6455f3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" Jul 08 18:38:33.200974 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:33.200936 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" Jul 08 18:38:33.341133 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:33.341107 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f"] Jul 08 18:38:33.343215 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:38:33.343177 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3e6148_dee9_4bfc_8d43_e504b6455f3f.slice/crio-6312c50552c2c1a7a2f5e4e6b426ac83c63608fe8f3e52bbfdd2e0c8a56f3b06 WatchSource:0}: Error finding container 6312c50552c2c1a7a2f5e4e6b426ac83c63608fe8f3e52bbfdd2e0c8a56f3b06: Status 404 returned error can't find the container with id 6312c50552c2c1a7a2f5e4e6b426ac83c63608fe8f3e52bbfdd2e0c8a56f3b06 Jul 08 18:38:34.279448 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:34.279397 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" event={"ID":"8a3e6148-dee9-4bfc-8d43-e504b6455f3f","Type":"ContainerStarted","Data":"fb2cdbd459d1d54a4604c8bcf45ff304a164a7883b4a960c4cc5e7716d6ec0ce"} Jul 08 18:38:34.279634 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:34.279456 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" event={"ID":"8a3e6148-dee9-4bfc-8d43-e504b6455f3f","Type":"ContainerStarted","Data":"6312c50552c2c1a7a2f5e4e6b426ac83c63608fe8f3e52bbfdd2e0c8a56f3b06"} Jul 08 18:38:34.279634 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:34.279485 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" Jul 08 18:38:34.302555 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:34.302500 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" podStartSLOduration=1.8959306219999998 podStartE2EDuration="2.302486605s" totalImagesPullingTime="406.555983ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:38:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:38:34.300195605 +0000 UTC m=+2048.544093784" watchObservedRunningTime="2026-07-08 18:38:34.302486605 +0000 UTC m=+2048.546384774" Jul 08 18:38:40.289648 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:40.289620 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" Jul 08 18:38:40.342397 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:40.342364 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh"] Jul 08 18:38:40.346170 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:40.346149 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" Jul 08 18:38:40.348848 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:40.348822 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-e6a5a1-serving-cert\"" Jul 08 18:38:40.356186 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:40.356162 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh"] Jul 08 18:38:40.466967 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:40.466929 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08509afe-8e73-48ab-968f-85ea3323c3c2-maas-api-tls\") pod \"maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh\" (UID: \"08509afe-8e73-48ab-968f-85ea3323c3c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" Jul 08 18:38:40.467185 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:40.467164 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cxft\" (UniqueName: \"kubernetes.io/projected/08509afe-8e73-48ab-968f-85ea3323c3c2-kube-api-access-9cxft\") pod \"maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh\" (UID: \"08509afe-8e73-48ab-968f-85ea3323c3c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" Jul 08 18:38:40.467243 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:40.467229 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08509afe-8e73-48ab-968f-85ea3323c3c2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh\" (UID: \"08509afe-8e73-48ab-968f-85ea3323c3c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" Jul 08 18:38:40.568675 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:40.568573 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cxft\" (UniqueName: \"kubernetes.io/projected/08509afe-8e73-48ab-968f-85ea3323c3c2-kube-api-access-9cxft\") pod \"maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh\" (UID: \"08509afe-8e73-48ab-968f-85ea3323c3c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" Jul 08 18:38:40.568675 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:40.568645 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08509afe-8e73-48ab-968f-85ea3323c3c2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh\" (UID: \"08509afe-8e73-48ab-968f-85ea3323c3c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" Jul 08 18:38:40.568675 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:40.568671 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08509afe-8e73-48ab-968f-85ea3323c3c2-maas-api-tls\") pod \"maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh\" (UID: \"08509afe-8e73-48ab-968f-85ea3323c3c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" Jul 08 18:38:40.569357 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:40.569335 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08509afe-8e73-48ab-968f-85ea3323c3c2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh\" (UID: \"08509afe-8e73-48ab-968f-85ea3323c3c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" Jul 08 18:38:40.571214 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:40.571188 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08509afe-8e73-48ab-968f-85ea3323c3c2-maas-api-tls\") pod \"maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh\" (UID: \"08509afe-8e73-48ab-968f-85ea3323c3c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" Jul 08 18:38:40.576952 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:40.576928 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cxft\" (UniqueName: \"kubernetes.io/projected/08509afe-8e73-48ab-968f-85ea3323c3c2-kube-api-access-9cxft\") pod \"maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh\" (UID: \"08509afe-8e73-48ab-968f-85ea3323c3c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" Jul 08 18:38:40.658772 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:40.658739 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" Jul 08 18:38:40.794478 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:40.794452 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh"] Jul 08 18:38:40.796690 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:38:40.796666 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08509afe_8e73_48ab_968f_85ea3323c3c2.slice/crio-db49e1a06ab994a20f2d74a38001e0dae526b185895a8687dad120fc264771a2 WatchSource:0}: Error finding container db49e1a06ab994a20f2d74a38001e0dae526b185895a8687dad120fc264771a2: Status 404 returned error can't find the container with id db49e1a06ab994a20f2d74a38001e0dae526b185895a8687dad120fc264771a2 Jul 08 18:38:41.320130 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:41.320104 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" event={"ID":"08509afe-8e73-48ab-968f-85ea3323c3c2","Type":"ContainerStarted","Data":"db49e1a06ab994a20f2d74a38001e0dae526b185895a8687dad120fc264771a2"} Jul 08 18:38:42.326967 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:42.326933 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" event={"ID":"08509afe-8e73-48ab-968f-85ea3323c3c2","Type":"ContainerStarted","Data":"cbd91469980cf7711d08b4f48a6b56526a75a4c9d83c14a791a098297832cb1a"} Jul 08 18:38:42.327371 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:42.327076 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" Jul 08 18:38:42.345662 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:42.345624 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" podStartSLOduration=1.841235846 podStartE2EDuration="2.345610245s" totalImagesPullingTime="504.374399ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:38:42.345214983 +0000 UTC m=+2056.589113164" watchObservedRunningTime="2026-07-08 18:38:42.345610245 +0000 UTC m=+2056.589508413" Jul 08 18:38:48.337131 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:38:48.337020 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" Jul 08 18:39:26.346972 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:39:26.346854 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9ftw_6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe/ovn-acl-logging/0.log" Jul 08 18:39:26.354688 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:39:26.354667 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9ftw_6d61ac2a-dd88-402c-a94f-5ee4d28ecbfe/ovn-acl-logging/0.log" Jul 08 18:41:50.567349 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:50.567273 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f"] Jul 08 18:41:50.567884 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:50.567492 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" podUID="8a3e6148-dee9-4bfc-8d43-e504b6455f3f" containerName="maas-api" containerID="cri-o://fb2cdbd459d1d54a4604c8bcf45ff304a164a7883b4a960c4cc5e7716d6ec0ce" gracePeriod=30 Jul 08 18:41:50.815811 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:50.815786 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" Jul 08 18:41:50.934775 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:50.934745 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-openshift-service-ca\") pod \"8a3e6148-dee9-4bfc-8d43-e504b6455f3f\" (UID: \"8a3e6148-dee9-4bfc-8d43-e504b6455f3f\") " Jul 08 18:41:50.934908 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:50.934777 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmj4s\" (UniqueName: \"kubernetes.io/projected/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-kube-api-access-fmj4s\") pod \"8a3e6148-dee9-4bfc-8d43-e504b6455f3f\" (UID: \"8a3e6148-dee9-4bfc-8d43-e504b6455f3f\") " Jul 08 18:41:50.934908 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:50.934806 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-maas-api-tls\") pod \"8a3e6148-dee9-4bfc-8d43-e504b6455f3f\" (UID: \"8a3e6148-dee9-4bfc-8d43-e504b6455f3f\") " Jul 08 18:41:50.935124 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:50.935096 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8a3e6148-dee9-4bfc-8d43-e504b6455f3f" (UID: "8a3e6148-dee9-4bfc-8d43-e504b6455f3f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:41:50.936876 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:50.936848 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8a3e6148-dee9-4bfc-8d43-e504b6455f3f" (UID: "8a3e6148-dee9-4bfc-8d43-e504b6455f3f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:41:50.936984 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:50.936911 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-kube-api-access-fmj4s" (OuterVolumeSpecName: "kube-api-access-fmj4s") pod "8a3e6148-dee9-4bfc-8d43-e504b6455f3f" (UID: "8a3e6148-dee9-4bfc-8d43-e504b6455f3f"). InnerVolumeSpecName "kube-api-access-fmj4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:41:51.036107 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:51.036082 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-maas-api-tls\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:41:51.036107 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:51.036104 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-openshift-service-ca\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:41:51.036244 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:51.036115 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmj4s\" (UniqueName: \"kubernetes.io/projected/8a3e6148-dee9-4bfc-8d43-e504b6455f3f-kube-api-access-fmj4s\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:41:51.322562 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:51.322471 2574 generic.go:356] "Generic (PLEG): container finished" podID="8a3e6148-dee9-4bfc-8d43-e504b6455f3f" containerID="fb2cdbd459d1d54a4604c8bcf45ff304a164a7883b4a960c4cc5e7716d6ec0ce" exitCode=0 Jul 08 18:41:51.322562 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:51.322508 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" Jul 08 18:41:51.322733 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:51.322569 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" event={"ID":"8a3e6148-dee9-4bfc-8d43-e504b6455f3f","Type":"ContainerDied","Data":"fb2cdbd459d1d54a4604c8bcf45ff304a164a7883b4a960c4cc5e7716d6ec0ce"} Jul 08 18:41:51.322733 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:51.322627 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f" event={"ID":"8a3e6148-dee9-4bfc-8d43-e504b6455f3f","Type":"ContainerDied","Data":"6312c50552c2c1a7a2f5e4e6b426ac83c63608fe8f3e52bbfdd2e0c8a56f3b06"} Jul 08 18:41:51.322733 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:51.322656 2574 scope.go:117] "RemoveContainer" containerID="fb2cdbd459d1d54a4604c8bcf45ff304a164a7883b4a960c4cc5e7716d6ec0ce" Jul 08 18:41:51.332343 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:51.332329 2574 scope.go:117] "RemoveContainer" containerID="fb2cdbd459d1d54a4604c8bcf45ff304a164a7883b4a960c4cc5e7716d6ec0ce" Jul 08 18:41:51.332638 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:41:51.332614 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb2cdbd459d1d54a4604c8bcf45ff304a164a7883b4a960c4cc5e7716d6ec0ce\": container with ID starting with fb2cdbd459d1d54a4604c8bcf45ff304a164a7883b4a960c4cc5e7716d6ec0ce not found: ID does not exist" containerID="fb2cdbd459d1d54a4604c8bcf45ff304a164a7883b4a960c4cc5e7716d6ec0ce" Jul 08 18:41:51.332735 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:51.332645 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb2cdbd459d1d54a4604c8bcf45ff304a164a7883b4a960c4cc5e7716d6ec0ce"} err="failed to get container status \"fb2cdbd459d1d54a4604c8bcf45ff304a164a7883b4a960c4cc5e7716d6ec0ce\": rpc error: code = NotFound desc = could not find container \"fb2cdbd459d1d54a4604c8bcf45ff304a164a7883b4a960c4cc5e7716d6ec0ce\": container with ID starting with fb2cdbd459d1d54a4604c8bcf45ff304a164a7883b4a960c4cc5e7716d6ec0ce not found: ID does not exist" Jul 08 18:41:51.345269 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:51.345248 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f"] Jul 08 18:41:51.349423 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:51.349393 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-deca3c-785bbc77f9-hcl9f"] Jul 08 18:41:52.270604 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:52.270573 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a3e6148-dee9-4bfc-8d43-e504b6455f3f" path="/var/lib/kubelet/pods/8a3e6148-dee9-4bfc-8d43-e504b6455f3f/volumes" Jul 08 18:41:57.990766 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:57.990736 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh"] Jul 08 18:41:57.991218 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:57.990954 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" podUID="08509afe-8e73-48ab-968f-85ea3323c3c2" containerName="maas-api" containerID="cri-o://cbd91469980cf7711d08b4f48a6b56526a75a4c9d83c14a791a098297832cb1a" gracePeriod=30 Jul 08 18:41:58.232211 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:58.232190 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" Jul 08 18:41:58.357878 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:58.357808 2574 generic.go:356] "Generic (PLEG): container finished" podID="08509afe-8e73-48ab-968f-85ea3323c3c2" containerID="cbd91469980cf7711d08b4f48a6b56526a75a4c9d83c14a791a098297832cb1a" exitCode=0 Jul 08 18:41:58.357878 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:58.357846 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" event={"ID":"08509afe-8e73-48ab-968f-85ea3323c3c2","Type":"ContainerDied","Data":"cbd91469980cf7711d08b4f48a6b56526a75a4c9d83c14a791a098297832cb1a"} Jul 08 18:41:58.358062 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:58.357882 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" event={"ID":"08509afe-8e73-48ab-968f-85ea3323c3c2","Type":"ContainerDied","Data":"db49e1a06ab994a20f2d74a38001e0dae526b185895a8687dad120fc264771a2"} Jul 08 18:41:58.358062 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:58.357905 2574 scope.go:117] "RemoveContainer" containerID="cbd91469980cf7711d08b4f48a6b56526a75a4c9d83c14a791a098297832cb1a" Jul 08 18:41:58.358062 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:58.357848 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh" Jul 08 18:41:58.371878 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:58.371854 2574 scope.go:117] "RemoveContainer" containerID="cbd91469980cf7711d08b4f48a6b56526a75a4c9d83c14a791a098297832cb1a" Jul 08 18:41:58.372258 ip-10-0-137-15 kubenswrapper[2574]: E0708 18:41:58.372222 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbd91469980cf7711d08b4f48a6b56526a75a4c9d83c14a791a098297832cb1a\": container with ID starting with cbd91469980cf7711d08b4f48a6b56526a75a4c9d83c14a791a098297832cb1a not found: ID does not exist" containerID="cbd91469980cf7711d08b4f48a6b56526a75a4c9d83c14a791a098297832cb1a" Jul 08 18:41:58.372349 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:58.372285 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbd91469980cf7711d08b4f48a6b56526a75a4c9d83c14a791a098297832cb1a"} err="failed to get container status \"cbd91469980cf7711d08b4f48a6b56526a75a4c9d83c14a791a098297832cb1a\": rpc error: code = NotFound desc = could not find container \"cbd91469980cf7711d08b4f48a6b56526a75a4c9d83c14a791a098297832cb1a\": container with ID starting with cbd91469980cf7711d08b4f48a6b56526a75a4c9d83c14a791a098297832cb1a not found: ID does not exist" Jul 08 18:41:58.392935 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:58.392915 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cxft\" (UniqueName: \"kubernetes.io/projected/08509afe-8e73-48ab-968f-85ea3323c3c2-kube-api-access-9cxft\") pod \"08509afe-8e73-48ab-968f-85ea3323c3c2\" (UID: \"08509afe-8e73-48ab-968f-85ea3323c3c2\") " Jul 08 18:41:58.393048 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:58.392965 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08509afe-8e73-48ab-968f-85ea3323c3c2-maas-api-tls\") pod \"08509afe-8e73-48ab-968f-85ea3323c3c2\" (UID: \"08509afe-8e73-48ab-968f-85ea3323c3c2\") " Jul 08 18:41:58.393048 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:58.393010 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08509afe-8e73-48ab-968f-85ea3323c3c2-openshift-service-ca\") pod \"08509afe-8e73-48ab-968f-85ea3323c3c2\" (UID: \"08509afe-8e73-48ab-968f-85ea3323c3c2\") " Jul 08 18:41:58.393441 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:58.393420 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08509afe-8e73-48ab-968f-85ea3323c3c2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "08509afe-8e73-48ab-968f-85ea3323c3c2" (UID: "08509afe-8e73-48ab-968f-85ea3323c3c2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:41:58.395056 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:58.395008 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08509afe-8e73-48ab-968f-85ea3323c3c2-kube-api-access-9cxft" (OuterVolumeSpecName: "kube-api-access-9cxft") pod "08509afe-8e73-48ab-968f-85ea3323c3c2" (UID: "08509afe-8e73-48ab-968f-85ea3323c3c2"). InnerVolumeSpecName "kube-api-access-9cxft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:41:58.395143 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:58.395120 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08509afe-8e73-48ab-968f-85ea3323c3c2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "08509afe-8e73-48ab-968f-85ea3323c3c2" (UID: "08509afe-8e73-48ab-968f-85ea3323c3c2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:41:58.494418 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:58.494396 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cxft\" (UniqueName: \"kubernetes.io/projected/08509afe-8e73-48ab-968f-85ea3323c3c2-kube-api-access-9cxft\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:41:58.494418 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:58.494417 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08509afe-8e73-48ab-968f-85ea3323c3c2-maas-api-tls\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:41:58.494534 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:58.494426 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08509afe-8e73-48ab-968f-85ea3323c3c2-openshift-service-ca\") on node \"ip-10-0-137-15.ec2.internal\" DevicePath \"\"" Jul 08 18:41:58.681458 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:58.681429 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh"] Jul 08 18:41:58.685668 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:41:58.685644 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e6a5a1-789485ddfb-cvnlh"] Jul 08 18:42:00.270523 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:00.270489 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08509afe-8e73-48ab-968f-85ea3323c3c2" path="/var/lib/kubelet/pods/08509afe-8e73-48ab-968f-85ea3323c3c2/volumes" Jul 08 18:42:10.185474 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:10.185441 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-859965ff4-kxwvb_54ff0713-3d3c-4667-84cb-2585177bed45/copy-manifests/0.log" Jul 08 18:42:10.210196 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:10.210168 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-859965ff4-kxwvb_54ff0713-3d3c-4667-84cb-2585177bed45/manager/0.log" Jul 08 18:42:11.110139 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:11.110104 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn_2e8ceb91-fa6a-4bbc-9557-523ef3b0081d/util/0.log" Jul 08 18:42:11.116949 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:11.116913 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn_2e8ceb91-fa6a-4bbc-9557-523ef3b0081d/pull/0.log" Jul 08 18:42:11.123843 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:11.123817 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn_2e8ceb91-fa6a-4bbc-9557-523ef3b0081d/extract/0.log" Jul 08 18:42:11.232174 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:11.232146 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k_98f8c692-9bf5-4328-830d-4b95d4ad2e00/util/0.log" Jul 08 18:42:11.239380 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:11.239359 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k_98f8c692-9bf5-4328-830d-4b95d4ad2e00/pull/0.log" Jul 08 18:42:11.245709 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:11.245678 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k_98f8c692-9bf5-4328-830d-4b95d4ad2e00/extract/0.log" Jul 08 18:42:11.354550 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:11.354516 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l_a0a9dd32-1626-44bd-8728-4771b658de15/pull/0.log" Jul 08 18:42:11.361922 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:11.361830 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l_a0a9dd32-1626-44bd-8728-4771b658de15/extract/0.log" Jul 08 18:42:11.369271 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:11.369251 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l_a0a9dd32-1626-44bd-8728-4771b658de15/util/0.log" Jul 08 18:42:11.482985 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:11.482961 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs_b1554484-d75d-4638-8342-87f826061280/util/0.log" Jul 08 18:42:11.491168 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:11.491143 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs_b1554484-d75d-4638-8342-87f826061280/pull/0.log" Jul 08 18:42:11.498229 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:11.498203 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs_b1554484-d75d-4638-8342-87f826061280/extract/0.log" Jul 08 18:42:12.219333 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:12.219305 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9ztzl_e620b391-1135-4353-bfa5-bb6e783c7d8f/manager/0.log" Jul 08 18:42:12.965988 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:12.965954 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qvmcl_fd5077e2-ecdb-40ee-a0e2-83138e2a7c86/discovery/0.log" Jul 08 18:42:13.568893 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:13.568863 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-jwwgx_5e253283-cd24-4803-a8a4-61066306d338/payload-processing/0.log" Jul 08 18:42:14.279887 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:14.279829 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rfrr5_a2479932-e180-4281-aa62-077f70c27d40/main/0.log" Jul 08 18:42:18.469793 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.469752 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9mvv9/must-gather-47nm8"] Jul 08 18:42:18.470330 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.470243 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08509afe-8e73-48ab-968f-85ea3323c3c2" containerName="maas-api" Jul 08 18:42:18.470330 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.470264 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="08509afe-8e73-48ab-968f-85ea3323c3c2" containerName="maas-api" Jul 08 18:42:18.470330 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.470299 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a3e6148-dee9-4bfc-8d43-e504b6455f3f" containerName="maas-api" Jul 08 18:42:18.470330 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.470307 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a3e6148-dee9-4bfc-8d43-e504b6455f3f" containerName="maas-api" Jul 08 18:42:18.470555 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.470387 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="08509afe-8e73-48ab-968f-85ea3323c3c2" containerName="maas-api" Jul 08 18:42:18.470555 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.470400 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a3e6148-dee9-4bfc-8d43-e504b6455f3f" containerName="maas-api" Jul 08 18:42:18.473766 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.473744 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9mvv9/must-gather-47nm8" Jul 08 18:42:18.476531 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.476512 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9mvv9\"/\"openshift-service-ca.crt\"" Jul 08 18:42:18.476610 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.476559 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9mvv9\"/\"kube-root-ca.crt\"" Jul 08 18:42:18.477517 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.477501 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9mvv9\"/\"default-dockercfg-tjq4t\"" Jul 08 18:42:18.482416 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.482390 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9mvv9/must-gather-47nm8"] Jul 08 18:42:18.544915 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.544896 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btkfw\" (UniqueName: \"kubernetes.io/projected/6d4a35da-efe6-4375-874e-a30d34cc9cd3-kube-api-access-btkfw\") pod \"must-gather-47nm8\" (UID: \"6d4a35da-efe6-4375-874e-a30d34cc9cd3\") " pod="openshift-must-gather-9mvv9/must-gather-47nm8" Jul 08 18:42:18.545019 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.544951 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6d4a35da-efe6-4375-874e-a30d34cc9cd3-must-gather-output\") pod \"must-gather-47nm8\" (UID: \"6d4a35da-efe6-4375-874e-a30d34cc9cd3\") " pod="openshift-must-gather-9mvv9/must-gather-47nm8" Jul 08 18:42:18.645288 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.645258 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btkfw\" (UniqueName: \"kubernetes.io/projected/6d4a35da-efe6-4375-874e-a30d34cc9cd3-kube-api-access-btkfw\") pod \"must-gather-47nm8\" (UID: \"6d4a35da-efe6-4375-874e-a30d34cc9cd3\") " pod="openshift-must-gather-9mvv9/must-gather-47nm8" Jul 08 18:42:18.645387 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.645349 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6d4a35da-efe6-4375-874e-a30d34cc9cd3-must-gather-output\") pod \"must-gather-47nm8\" (UID: \"6d4a35da-efe6-4375-874e-a30d34cc9cd3\") " pod="openshift-must-gather-9mvv9/must-gather-47nm8" Jul 08 18:42:18.645648 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.645625 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6d4a35da-efe6-4375-874e-a30d34cc9cd3-must-gather-output\") pod \"must-gather-47nm8\" (UID: \"6d4a35da-efe6-4375-874e-a30d34cc9cd3\") " pod="openshift-must-gather-9mvv9/must-gather-47nm8" Jul 08 18:42:18.654951 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.654926 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btkfw\" (UniqueName: \"kubernetes.io/projected/6d4a35da-efe6-4375-874e-a30d34cc9cd3-kube-api-access-btkfw\") pod \"must-gather-47nm8\" (UID: \"6d4a35da-efe6-4375-874e-a30d34cc9cd3\") " pod="openshift-must-gather-9mvv9/must-gather-47nm8" Jul 08 18:42:18.784435 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.784380 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9mvv9/must-gather-47nm8" Jul 08 18:42:18.915369 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.915344 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9mvv9/must-gather-47nm8"] Jul 08 18:42:18.917194 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:42:18.917167 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d4a35da_efe6_4375_874e_a30d34cc9cd3.slice/crio-41d887b67a5db3c05ac5d6bb4acc69cfb7fb9d92855e0b275dfc803973601a09 WatchSource:0}: Error finding container 41d887b67a5db3c05ac5d6bb4acc69cfb7fb9d92855e0b275dfc803973601a09: Status 404 returned error can't find the container with id 41d887b67a5db3c05ac5d6bb4acc69cfb7fb9d92855e0b275dfc803973601a09 Jul 08 18:42:18.918946 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:18.918928 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:42:19.470515 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:19.470480 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9mvv9/must-gather-47nm8" event={"ID":"6d4a35da-efe6-4375-874e-a30d34cc9cd3","Type":"ContainerStarted","Data":"41d887b67a5db3c05ac5d6bb4acc69cfb7fb9d92855e0b275dfc803973601a09"} Jul 08 18:42:20.481158 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:20.481121 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9mvv9/must-gather-47nm8" event={"ID":"6d4a35da-efe6-4375-874e-a30d34cc9cd3","Type":"ContainerStarted","Data":"fdbf801613b0f731b047fee81f187ef0213e555ee8410ac887b22ad8f8e614a9"} Jul 08 18:42:20.481627 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:20.481170 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9mvv9/must-gather-47nm8" event={"ID":"6d4a35da-efe6-4375-874e-a30d34cc9cd3","Type":"ContainerStarted","Data":"4f082c4237c3709b94554e77a2ecbe92d0236b02ffbcf1f6bf978a0caad52b71"} Jul 08 18:42:20.498685 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:20.498640 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9mvv9/must-gather-47nm8" podStartSLOduration=1.477887799 podStartE2EDuration="2.498624125s" totalImagesPullingTime="1.020736326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:42:20.496899825 +0000 UTC m=+2274.740797992" watchObservedRunningTime="2026-07-08 18:42:20.498624125 +0000 UTC m=+2274.742522289" Jul 08 18:42:21.537175 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:21.537122 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rj4rd_d43bf8f7-16a4-4595-8185-6de3d1880faf/global-pull-secret-syncer/0.log" Jul 08 18:42:21.707146 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:21.707110 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ntsb7_3ac4ecbf-8862-4292-a3cf-40ac2f4c003c/konnectivity-agent/0.log" Jul 08 18:42:21.754413 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:21.754385 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-15.ec2.internal_fc962ef72161a4d249d8dfa152df87aa/haproxy/0.log" Jul 08 18:42:25.919708 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:25.919669 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn_2e8ceb91-fa6a-4bbc-9557-523ef3b0081d/extract/0.log" Jul 08 18:42:25.944483 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:25.944449 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn_2e8ceb91-fa6a-4bbc-9557-523ef3b0081d/util/0.log" Jul 08 18:42:25.971971 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:25.971939 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592d6fn_2e8ceb91-fa6a-4bbc-9557-523ef3b0081d/pull/0.log" Jul 08 18:42:26.006064 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:26.006019 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k_98f8c692-9bf5-4328-830d-4b95d4ad2e00/extract/0.log" Jul 08 18:42:26.029369 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:26.029337 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k_98f8c692-9bf5-4328-830d-4b95d4ad2e00/util/0.log" Jul 08 18:42:26.054958 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:26.054921 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tcv8k_98f8c692-9bf5-4328-830d-4b95d4ad2e00/pull/0.log" Jul 08 18:42:26.084099 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:26.084070 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l_a0a9dd32-1626-44bd-8728-4771b658de15/extract/0.log" Jul 08 18:42:26.111862 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:26.111828 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l_a0a9dd32-1626-44bd-8728-4771b658de15/util/0.log" Jul 08 18:42:26.137175 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:26.137149 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcs7l_a0a9dd32-1626-44bd-8728-4771b658de15/pull/0.log" Jul 08 18:42:26.170795 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:26.170766 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs_b1554484-d75d-4638-8342-87f826061280/extract/0.log" Jul 08 18:42:26.196676 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:26.196647 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs_b1554484-d75d-4638-8342-87f826061280/util/0.log" Jul 08 18:42:26.219281 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:26.219231 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vnlfs_b1554484-d75d-4638-8342-87f826061280/pull/0.log" Jul 08 18:42:26.771922 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:26.771849 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9ztzl_e620b391-1135-4353-bfa5-bb6e783c7d8f/manager/0.log" Jul 08 18:42:28.640139 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:28.640097 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-rppgs_ec59eec4-a9bf-4bb4-8331-778068a820a2/kube-state-metrics/0.log" Jul 08 18:42:28.661729 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:28.661703 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-rppgs_ec59eec4-a9bf-4bb4-8331-778068a820a2/kube-rbac-proxy-main/0.log" Jul 08 18:42:28.688704 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:28.688680 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-rppgs_ec59eec4-a9bf-4bb4-8331-778068a820a2/kube-rbac-proxy-self/0.log" Jul 08 18:42:28.719410 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:28.719375 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7695869b89-2vzc2_b8f8bbf3-facd-484a-8b30-cfc67b85d4c5/metrics-server/0.log" Jul 08 18:42:28.896141 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:28.896014 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b7dg6_40e65754-2547-4c64-a6a0-28a0d8e1f863/node-exporter/0.log" Jul 08 18:42:28.926744 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:28.926709 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b7dg6_40e65754-2547-4c64-a6a0-28a0d8e1f863/kube-rbac-proxy/0.log" Jul 08 18:42:28.951926 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:28.951889 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b7dg6_40e65754-2547-4c64-a6a0-28a0d8e1f863/init-textfile/0.log" Jul 08 18:42:29.064299 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:29.064266 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-n52d8_87e8fbf5-8160-4922-a15d-5c4429fef281/kube-rbac-proxy-main/0.log" Jul 08 18:42:29.116132 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:29.116104 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-n52d8_87e8fbf5-8160-4922-a15d-5c4429fef281/kube-rbac-proxy-self/0.log" Jul 08 18:42:29.178010 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:29.177976 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-n52d8_87e8fbf5-8160-4922-a15d-5c4429fef281/openshift-state-metrics/0.log" Jul 08 18:42:29.527854 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:29.527440 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-qrhcw_a927a850-002b-47d1-8666-c6f46d14791d/prometheus-operator-admission-webhook/0.log" Jul 08 18:42:31.641530 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:31.641491 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv"] Jul 08 18:42:31.645105 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:31.645077 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" Jul 08 18:42:31.655908 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:31.655773 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv"] Jul 08 18:42:31.776311 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:31.776277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b34b02cd-fe88-4193-a8bc-b82fd09c99c3-lib-modules\") pod \"perf-node-gather-daemonset-nv4pv\" (UID: \"b34b02cd-fe88-4193-a8bc-b82fd09c99c3\") " pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" Jul 08 18:42:31.776616 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:31.776595 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b34b02cd-fe88-4193-a8bc-b82fd09c99c3-proc\") pod \"perf-node-gather-daemonset-nv4pv\" (UID: \"b34b02cd-fe88-4193-a8bc-b82fd09c99c3\") " pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" Jul 08 18:42:31.776758 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:31.776744 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b34b02cd-fe88-4193-a8bc-b82fd09c99c3-podres\") pod \"perf-node-gather-daemonset-nv4pv\" (UID: \"b34b02cd-fe88-4193-a8bc-b82fd09c99c3\") " pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" Jul 08 18:42:31.776860 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:31.776845 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6knv2\" (UniqueName: \"kubernetes.io/projected/b34b02cd-fe88-4193-a8bc-b82fd09c99c3-kube-api-access-6knv2\") pod \"perf-node-gather-daemonset-nv4pv\" (UID: \"b34b02cd-fe88-4193-a8bc-b82fd09c99c3\") " pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" Jul 08 18:42:31.777001 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:31.776989 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b34b02cd-fe88-4193-a8bc-b82fd09c99c3-sys\") pod \"perf-node-gather-daemonset-nv4pv\" (UID: \"b34b02cd-fe88-4193-a8bc-b82fd09c99c3\") " pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" Jul 08 18:42:31.878528 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:31.878493 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b34b02cd-fe88-4193-a8bc-b82fd09c99c3-proc\") pod \"perf-node-gather-daemonset-nv4pv\" (UID: \"b34b02cd-fe88-4193-a8bc-b82fd09c99c3\") " pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" Jul 08 18:42:31.878702 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:31.878550 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b34b02cd-fe88-4193-a8bc-b82fd09c99c3-podres\") pod \"perf-node-gather-daemonset-nv4pv\" (UID: \"b34b02cd-fe88-4193-a8bc-b82fd09c99c3\") " pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" Jul 08 18:42:31.878702 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:31.878579 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6knv2\" (UniqueName: \"kubernetes.io/projected/b34b02cd-fe88-4193-a8bc-b82fd09c99c3-kube-api-access-6knv2\") pod \"perf-node-gather-daemonset-nv4pv\" (UID: \"b34b02cd-fe88-4193-a8bc-b82fd09c99c3\") " pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" Jul 08 18:42:31.878702 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:31.878630 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b34b02cd-fe88-4193-a8bc-b82fd09c99c3-sys\") pod \"perf-node-gather-daemonset-nv4pv\" (UID: \"b34b02cd-fe88-4193-a8bc-b82fd09c99c3\") " pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" Jul 08 18:42:31.878702 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:31.878634 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b34b02cd-fe88-4193-a8bc-b82fd09c99c3-proc\") pod \"perf-node-gather-daemonset-nv4pv\" (UID: \"b34b02cd-fe88-4193-a8bc-b82fd09c99c3\") " pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" Jul 08 18:42:31.878702 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:31.878666 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b34b02cd-fe88-4193-a8bc-b82fd09c99c3-lib-modules\") pod \"perf-node-gather-daemonset-nv4pv\" (UID: \"b34b02cd-fe88-4193-a8bc-b82fd09c99c3\") " pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" Jul 08 18:42:31.878702 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:31.878685 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b34b02cd-fe88-4193-a8bc-b82fd09c99c3-podres\") pod \"perf-node-gather-daemonset-nv4pv\" (UID: \"b34b02cd-fe88-4193-a8bc-b82fd09c99c3\") " pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" Jul 08 18:42:31.878939 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:31.878707 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b34b02cd-fe88-4193-a8bc-b82fd09c99c3-sys\") pod \"perf-node-gather-daemonset-nv4pv\" (UID: \"b34b02cd-fe88-4193-a8bc-b82fd09c99c3\") " pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" Jul 08 18:42:31.878939 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:31.878805 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b34b02cd-fe88-4193-a8bc-b82fd09c99c3-lib-modules\") pod \"perf-node-gather-daemonset-nv4pv\" (UID: \"b34b02cd-fe88-4193-a8bc-b82fd09c99c3\") " pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" Jul 08 18:42:31.886679 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:31.886649 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6knv2\" (UniqueName: \"kubernetes.io/projected/b34b02cd-fe88-4193-a8bc-b82fd09c99c3-kube-api-access-6knv2\") pod \"perf-node-gather-daemonset-nv4pv\" (UID: \"b34b02cd-fe88-4193-a8bc-b82fd09c99c3\") " pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" Jul 08 18:42:31.961154 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:31.961124 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" Jul 08 18:42:32.139062 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:32.138951 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv"] Jul 08 18:42:32.144241 ip-10-0-137-15 kubenswrapper[2574]: W0708 18:42:32.142536 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb34b02cd_fe88_4193_a8bc_b82fd09c99c3.slice/crio-db910a6e7eabd7182d813340bb612d19fefbb1341a8d4f2ac1a39d923d496daa WatchSource:0}: Error finding container db910a6e7eabd7182d813340bb612d19fefbb1341a8d4f2ac1a39d923d496daa: Status 404 returned error can't find the container with id db910a6e7eabd7182d813340bb612d19fefbb1341a8d4f2ac1a39d923d496daa Jul 08 18:42:32.216224 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:32.216172 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74fd9d7449-sprrk_747d5f57-5ab0-4ec0-b231-4db9c215fbfa/console/0.log" Jul 08 18:42:32.572365 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:32.572274 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" event={"ID":"b34b02cd-fe88-4193-a8bc-b82fd09c99c3","Type":"ContainerStarted","Data":"6dcb19df64616de4245d916ccf0e9fbd93a52dc05670ceb0ae7bd9cfa3aac575"} Jul 08 18:42:32.572365 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:32.572333 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" event={"ID":"b34b02cd-fe88-4193-a8bc-b82fd09c99c3","Type":"ContainerStarted","Data":"db910a6e7eabd7182d813340bb612d19fefbb1341a8d4f2ac1a39d923d496daa"} Jul 08 18:42:32.572566 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:32.572396 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" Jul 08 18:42:33.839235 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:33.839205 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-66fq4_ad84f73e-6bc8-4508-97ec-ef3138d4685f/dns/0.log" Jul 08 18:42:33.861012 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:33.860985 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-66fq4_ad84f73e-6bc8-4508-97ec-ef3138d4685f/kube-rbac-proxy/0.log" Jul 08 18:42:34.010280 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:34.010246 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vvdbr_545d8c89-dbd7-4cb3-b5dd-83b8089c7c1e/dns-node-resolver/0.log" Jul 08 18:42:34.579201 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:34.579158 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-58b7c645bc-fvjx2_10ed572b-9033-483f-ac88-a23fc874b33c/registry/0.log" Jul 08 18:42:34.656916 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:34.656883 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jwz48_176823c4-1003-4325-a3fd-801fedcd0b43/node-ca/0.log" Jul 08 18:42:35.799584 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:35.799546 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qvmcl_fd5077e2-ecdb-40ee-a0e2-83138e2a7c86/discovery/0.log" Jul 08 18:42:36.017350 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:36.017307 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-jwwgx_5e253283-cd24-4803-a8a4-61066306d338/payload-processing/0.log" Jul 08 18:42:36.718883 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:36.718851 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l8ggh_82f820f2-a049-41be-a661-f822def1a3ea/serve-healthcheck-canary/0.log" Jul 08 18:42:37.320541 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:37.320509 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m6jc4_0e4feae0-24bb-400d-976c-3db46684588e/kube-rbac-proxy/0.log" Jul 08 18:42:37.342883 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:37.342842 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m6jc4_0e4feae0-24bb-400d-976c-3db46684588e/exporter/0.log" Jul 08 18:42:37.364668 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:37.364630 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m6jc4_0e4feae0-24bb-400d-976c-3db46684588e/extractor/0.log" Jul 08 18:42:38.588779 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:38.588750 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" Jul 08 18:42:38.610514 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:38.609799 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9mvv9/perf-node-gather-daemonset-nv4pv" podStartSLOduration=7.609781572 podStartE2EDuration="7.609781572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:42:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:42:32.592313724 +0000 UTC m=+2286.836211889" watchObservedRunningTime="2026-07-08 18:42:38.609781572 +0000 UTC m=+2292.853679740" Jul 08 18:42:39.981954 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:39.981920 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-859965ff4-kxwvb_54ff0713-3d3c-4667-84cb-2585177bed45/manager/0.log" Jul 08 18:42:40.002166 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:40.002141 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-859965ff4-kxwvb_54ff0713-3d3c-4667-84cb-2585177bed45/copy-manifests/0.log" Jul 08 18:42:41.462360 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:41.462325 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68bbd4cf59-x6dqg_d6665a10-a660-4259-9e6c-504b1e9a9a76/manager/0.log" Jul 08 18:42:41.491560 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:41.491528 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-nb695_b894f765-1370-4037-afc8-321712e9eb40/openshift-lws-operator/0.log" Jul 08 18:42:42.059810 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:42.059780 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qvmcl_fd5077e2-ecdb-40ee-a0e2-83138e2a7c86/discovery/0.log" Jul 08 18:42:42.224419 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:42.224386 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-jwwgx_5e253283-cd24-4803-a8a4-61066306d338/payload-processing/0.log" Jul 08 18:42:43.550054 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:43.549928 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qvmcl_fd5077e2-ecdb-40ee-a0e2-83138e2a7c86/discovery/0.log" Jul 08 18:42:43.716170 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:43.716113 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-jwwgx_5e253283-cd24-4803-a8a4-61066306d338/payload-processing/0.log" Jul 08 18:42:47.983488 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:47.983453 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7mggs_7f3b0d99-28f8-4f35-a092-5be6eec3c766/kube-multus/0.log" Jul 08 18:42:48.205183 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:48.205157 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kbs6w_8e33d81c-69f4-41eb-8cfc-ca1563123bbb/kube-multus-additional-cni-plugins/0.log" Jul 08 18:42:48.236524 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:48.236451 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kbs6w_8e33d81c-69f4-41eb-8cfc-ca1563123bbb/egress-router-binary-copy/0.log" Jul 08 18:42:48.263099 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:48.263074 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kbs6w_8e33d81c-69f4-41eb-8cfc-ca1563123bbb/cni-plugins/0.log" Jul 08 18:42:48.285655 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:48.285631 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kbs6w_8e33d81c-69f4-41eb-8cfc-ca1563123bbb/bond-cni-plugin/0.log" Jul 08 18:42:48.308595 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:48.308570 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kbs6w_8e33d81c-69f4-41eb-8cfc-ca1563123bbb/routeoverride-cni/0.log" Jul 08 18:42:48.333785 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:48.333747 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kbs6w_8e33d81c-69f4-41eb-8cfc-ca1563123bbb/whereabouts-cni-bincopy/0.log" Jul 08 18:42:48.358072 ip-10-0-137-15 kubenswrapper[2574]: I0708 18:42:48.358040 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kbs6w_8e33d81c-69f4-41eb-8cfc-ca1563123bbb/whereabouts-cni/0.log"