Jul 22 02:16:38.775961 ip-10-0-137-41 systemd[1]: Starting Kubernetes Kubelet... Jul 22 02:16:39.365651 ip-10-0-137-41 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 02:16:39.365651 ip-10-0-137-41 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 22 02:16:39.365651 ip-10-0-137-41 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 02:16:39.365651 ip-10-0-137-41 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 22 02:16:39.365651 ip-10-0-137-41 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 02:16:39.365651 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.280486 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 22 02:16:39.365651 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293579 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 02:16:39.365651 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293601 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 02:16:39.365651 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293605 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 02:16:39.365651 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293609 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 02:16:39.365651 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293613 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 02:16:39.365651 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293616 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 02:16:39.365651 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293620 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 02:16:39.365651 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293623 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 02:16:39.366911 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293626 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 02:16:39.366911 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293629 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 02:16:39.366911 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293632 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 02:16:39.366911 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293635 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 02:16:39.366911 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293657 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 02:16:39.366911 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293661 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 02:16:39.366911 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293664 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 02:16:39.366911 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293667 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 02:16:39.366911 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293670 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 02:16:39.366911 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293673 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 02:16:39.366911 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293675 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 02:16:39.366911 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293678 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 02:16:39.366911 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293680 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 02:16:39.366911 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293683 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 02:16:39.366911 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293686 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 02:16:39.366911 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293688 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 02:16:39.366911 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293691 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 02:16:39.366911 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293694 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 02:16:39.366911 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293698 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 02:16:39.366911 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293710 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 02:16:39.367531 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293713 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 02:16:39.367531 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293716 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 02:16:39.367531 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293718 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 02:16:39.367531 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293721 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 02:16:39.367531 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293724 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 02:16:39.367531 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293727 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 22 02:16:39.367531 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293729 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 02:16:39.367531 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293732 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 02:16:39.367531 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293735 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 02:16:39.367531 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293737 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 02:16:39.367531 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293740 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 02:16:39.367531 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293742 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 02:16:39.367531 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293745 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 02:16:39.367531 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293747 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 02:16:39.367531 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293750 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 02:16:39.367531 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293753 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 02:16:39.367531 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293758 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 02:16:39.367531 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293763 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 02:16:39.367531 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293767 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 02:16:39.368162 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293772 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 02:16:39.368162 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293775 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 02:16:39.368162 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293778 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 02:16:39.368162 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293781 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 02:16:39.368162 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293784 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 02:16:39.368162 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293787 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 02:16:39.368162 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293790 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 02:16:39.368162 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293793 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 02:16:39.368162 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293797 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 02:16:39.368162 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293801 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 02:16:39.368162 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293805 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 02:16:39.368162 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293808 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 02:16:39.368162 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293811 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 02:16:39.368162 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293813 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 02:16:39.368162 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293816 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 02:16:39.368162 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293819 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 02:16:39.368162 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293822 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 02:16:39.368162 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293824 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 02:16:39.368797 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293828 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 02:16:39.368797 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293830 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 02:16:39.368797 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293833 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 02:16:39.368797 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293835 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 02:16:39.368797 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293838 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 02:16:39.368797 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293841 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 02:16:39.368797 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293843 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 02:16:39.368797 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293846 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 02:16:39.368797 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293849 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 02:16:39.368797 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293852 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 02:16:39.368797 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293854 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 02:16:39.368797 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293857 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 02:16:39.368797 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293859 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 02:16:39.368797 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293862 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 02:16:39.368797 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293864 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 02:16:39.368797 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293867 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 02:16:39.368797 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293870 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 02:16:39.368797 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293873 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 02:16:39.368797 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293877 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 02:16:39.368797 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293880 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 02:16:39.369473 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293882 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 02:16:39.369473 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293885 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 02:16:39.369473 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293888 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 02:16:39.369473 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293891 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 02:16:39.369473 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293893 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 02:16:39.369473 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293896 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 02:16:39.369473 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293899 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 02:16:39.369473 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293901 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 02:16:39.369473 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293904 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 02:16:39.369473 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293906 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 02:16:39.369473 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293909 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 02:16:39.369473 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293912 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 02:16:39.369473 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293914 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 02:16:39.369473 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.293917 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 02:16:39.369473 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294678 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 02:16:39.369473 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294685 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 02:16:39.369473 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294689 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 02:16:39.369473 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294691 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 02:16:39.369473 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294694 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 02:16:39.369473 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294697 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 02:16:39.370023 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294700 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 02:16:39.370023 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294702 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 02:16:39.370023 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294705 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 02:16:39.370023 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294707 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 02:16:39.370023 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294710 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 02:16:39.370023 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294713 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 02:16:39.370023 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294716 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 02:16:39.370023 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294718 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 02:16:39.370023 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294721 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 02:16:39.370023 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294724 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 02:16:39.370023 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294727 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 02:16:39.370023 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294730 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 02:16:39.370023 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294733 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 02:16:39.370023 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294736 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 02:16:39.370023 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294738 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 02:16:39.370023 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294741 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 02:16:39.370023 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294743 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 02:16:39.370023 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294746 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 02:16:39.370023 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294749 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 02:16:39.370023 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294752 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 02:16:39.370610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294754 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 02:16:39.370610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294757 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 02:16:39.370610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294759 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 02:16:39.370610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294761 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 02:16:39.370610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294764 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 02:16:39.370610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294767 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 02:16:39.370610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294769 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 02:16:39.370610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294772 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 02:16:39.370610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294775 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 02:16:39.370610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294777 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 02:16:39.370610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294780 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 02:16:39.370610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294782 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 02:16:39.370610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294785 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 02:16:39.370610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294789 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 02:16:39.370610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294791 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 02:16:39.370610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294794 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 02:16:39.370610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294797 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 02:16:39.370610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294799 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 02:16:39.370610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294802 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 02:16:39.370610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294805 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 02:16:39.371370 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294808 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 02:16:39.371370 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294810 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 02:16:39.371370 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294812 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 02:16:39.371370 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294816 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 02:16:39.371370 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294819 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 02:16:39.371370 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294822 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 02:16:39.371370 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294824 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 02:16:39.371370 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294827 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 02:16:39.371370 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294829 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 02:16:39.371370 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294832 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 02:16:39.371370 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294847 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 02:16:39.371370 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294851 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 02:16:39.371370 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294854 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 02:16:39.371370 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294856 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 02:16:39.371370 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294860 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 02:16:39.371370 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294863 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 02:16:39.371370 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294866 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 02:16:39.371370 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294868 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 02:16:39.371370 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294871 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 02:16:39.371370 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294874 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 02:16:39.372096 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294878 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 02:16:39.372096 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294881 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 02:16:39.372096 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294885 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 02:16:39.372096 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294887 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 02:16:39.372096 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294892 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 02:16:39.372096 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294896 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 02:16:39.372096 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294899 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 02:16:39.372096 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294902 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 02:16:39.372096 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294905 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 02:16:39.372096 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294907 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 02:16:39.372096 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294910 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 02:16:39.372096 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294912 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 02:16:39.372096 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294915 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 02:16:39.372096 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294918 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 02:16:39.372096 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294920 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 02:16:39.372096 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294923 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 02:16:39.372096 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294925 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 02:16:39.372096 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294928 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 02:16:39.372623 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294931 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 02:16:39.372623 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294934 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 02:16:39.372623 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294936 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 02:16:39.372623 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294939 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 02:16:39.372623 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294941 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 02:16:39.372623 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294944 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 02:16:39.372623 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294947 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 02:16:39.372623 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294951 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 02:16:39.372623 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294954 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 02:16:39.372623 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294957 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 22 02:16:39.372623 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294960 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 02:16:39.372623 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294963 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 02:16:39.372623 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294966 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 02:16:39.372623 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294969 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 02:16:39.372623 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.294971 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 02:16:39.372623 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295367 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 02:16:39.372623 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295373 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 02:16:39.372623 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295376 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 02:16:39.372623 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295379 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 02:16:39.373205 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295381 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 02:16:39.373205 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295384 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 02:16:39.373205 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295386 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 02:16:39.373205 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295389 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 02:16:39.373205 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295391 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 02:16:39.373205 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295396 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 02:16:39.373205 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295399 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 02:16:39.373205 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295403 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 02:16:39.373205 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295406 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 02:16:39.373205 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295409 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 02:16:39.373205 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295412 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 02:16:39.373205 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295415 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 02:16:39.373205 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295424 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 02:16:39.373205 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295427 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 02:16:39.373205 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295430 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 02:16:39.373205 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295432 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 02:16:39.373205 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295435 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 02:16:39.373205 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295438 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 02:16:39.373205 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295442 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 02:16:39.373777 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295445 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 02:16:39.373777 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295447 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 02:16:39.373777 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295450 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 02:16:39.373777 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295452 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 02:16:39.373777 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295455 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 02:16:39.373777 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295457 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 02:16:39.373777 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295460 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 02:16:39.373777 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295463 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 02:16:39.373777 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295466 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 02:16:39.373777 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295468 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 02:16:39.373777 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295471 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 02:16:39.373777 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295473 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 02:16:39.373777 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295476 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 02:16:39.373777 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295479 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 02:16:39.373777 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295481 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 02:16:39.373777 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295484 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 02:16:39.373777 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295486 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 02:16:39.373777 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295489 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 02:16:39.373777 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295491 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 02:16:39.373777 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295494 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 02:16:39.375141 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295496 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 02:16:39.375141 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295499 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 02:16:39.375141 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295501 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 02:16:39.375141 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295504 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 02:16:39.375141 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295507 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 02:16:39.375141 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295511 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 02:16:39.375141 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295514 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 02:16:39.375141 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295517 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 02:16:39.375141 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295519 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 02:16:39.375141 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295522 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 02:16:39.375141 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295525 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 02:16:39.375141 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295527 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 02:16:39.375141 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295529 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 02:16:39.375141 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295532 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 02:16:39.375141 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295534 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 02:16:39.375141 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295537 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 02:16:39.375141 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295539 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 02:16:39.375141 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295542 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 02:16:39.375141 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295544 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 02:16:39.375845 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295547 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 02:16:39.375845 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295551 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 02:16:39.375845 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295553 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 02:16:39.375845 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295556 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 02:16:39.375845 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295559 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 02:16:39.375845 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295561 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 02:16:39.375845 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295564 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 02:16:39.375845 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295567 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 02:16:39.375845 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295571 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 22 02:16:39.375845 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295573 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 02:16:39.375845 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295576 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 02:16:39.375845 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295579 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 02:16:39.375845 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295581 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 02:16:39.375845 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295584 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 02:16:39.375845 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295586 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 02:16:39.375845 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295589 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 02:16:39.375845 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295591 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 02:16:39.375845 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295595 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 02:16:39.375845 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295599 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 02:16:39.375845 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295601 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295605 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295607 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295610 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295612 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295615 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295617 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295620 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295622 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295625 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295627 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295630 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295632 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295635 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295655 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295658 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295660 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.295663 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295734 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295741 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295747 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 22 02:16:39.377037 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295752 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295757 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295760 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295765 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295769 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295772 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295775 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295778 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295782 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295785 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295789 2556 flags.go:64] FLAG: --cgroup-root="" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295792 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295796 2556 flags.go:64] FLAG: --client-ca-file="" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295799 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295802 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295807 2556 flags.go:64] FLAG: --cluster-domain="" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295810 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295813 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295816 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295819 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295823 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295826 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295829 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 22 02:16:39.377761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295832 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295835 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295839 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295842 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295845 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295848 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295852 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295855 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295858 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295861 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295864 2556 flags.go:64] FLAG: --enable-server="true" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295867 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295877 2556 flags.go:64] FLAG: --event-burst="100" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295880 2556 flags.go:64] FLAG: --event-qps="50" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295883 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295886 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295889 2556 flags.go:64] FLAG: --eviction-hard="" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295893 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295896 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295902 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295905 2556 flags.go:64] FLAG: --eviction-soft="" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295908 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295910 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295919 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295922 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 22 02:16:39.378934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295925 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295928 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295931 2556 flags.go:64] FLAG: --feature-gates="" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295934 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295938 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295941 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295944 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295947 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295950 2556 flags.go:64] FLAG: --help="false" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295954 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-137-41.ec2.internal" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295957 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295960 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295963 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295966 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295969 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295972 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295975 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295977 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295980 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295983 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295986 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295989 2556 flags.go:64] FLAG: --kube-reserved="" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295992 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295994 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 22 02:16:39.380039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.295997 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296000 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296004 2556 flags.go:64] FLAG: --lock-file="" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296007 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296010 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296013 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296018 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296026 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296030 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296032 2556 flags.go:64] FLAG: --logging-format="text" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296035 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296038 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296041 2556 flags.go:64] FLAG: --manifest-url="" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296044 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296052 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296055 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296059 2556 flags.go:64] FLAG: --max-pods="110" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296064 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296067 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296069 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296072 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296075 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296078 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296081 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296088 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 22 02:16:39.381978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296091 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296094 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296097 2556 flags.go:64] FLAG: --pod-cidr="" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296100 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296105 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296108 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296111 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296113 2556 flags.go:64] FLAG: --port="10250" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296116 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296120 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b0e1c63f87efb9b5" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296123 2556 flags.go:64] FLAG: --qos-reserved="" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296126 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296129 2556 flags.go:64] FLAG: --register-node="true" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296132 2556 flags.go:64] FLAG: --register-with-taints="" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296136 2556 flags.go:64] FLAG: --registry-burst="10" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296140 2556 flags.go:64] FLAG: --registry-qps="5" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296142 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296145 2556 flags.go:64] FLAG: --reserved-memory="" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296149 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296152 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296155 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296157 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296160 2556 flags.go:64] FLAG: --runonce="false" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296163 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296166 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 22 02:16:39.382847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296170 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296173 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296176 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296179 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296182 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296185 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296187 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296190 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296193 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296196 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296199 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296202 2556 flags.go:64] FLAG: --system-cgroups="" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296205 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296210 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296213 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296216 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296224 2556 flags.go:64] FLAG: --tls-min-version="" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296227 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296230 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296233 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296236 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296239 2556 flags.go:64] FLAG: --v="2" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296243 2556 flags.go:64] FLAG: --version="false" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296250 2556 flags.go:64] FLAG: --vmodule="" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296253 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 22 02:16:39.383526 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296257 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 22 02:16:39.384386 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296410 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 02:16:39.384386 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296415 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 02:16:39.384386 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296418 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 02:16:39.384386 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296421 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 02:16:39.384386 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296424 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 02:16:39.384386 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296427 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 02:16:39.384386 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296432 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 02:16:39.384386 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296434 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 02:16:39.384386 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296437 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 02:16:39.384386 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296440 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 02:16:39.384386 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296442 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 02:16:39.384386 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296445 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 02:16:39.384386 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296448 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 02:16:39.384386 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296450 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 02:16:39.384386 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296453 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 02:16:39.384386 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296455 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 02:16:39.384386 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296458 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 02:16:39.384386 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296460 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 02:16:39.384386 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296463 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 02:16:39.384386 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296465 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 02:16:39.450186 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296468 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 02:16:39.450186 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296470 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 02:16:39.450186 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296474 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 02:16:39.450186 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296477 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 02:16:39.450186 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296479 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 02:16:39.450186 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296482 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 02:16:39.450186 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296485 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 02:16:39.450186 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296487 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 02:16:39.450186 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296491 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 02:16:39.450186 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296495 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 02:16:39.450186 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296502 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 02:16:39.450186 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296505 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 02:16:39.450186 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296508 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 02:16:39.450186 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296510 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 02:16:39.450186 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296513 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 02:16:39.450186 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296516 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 02:16:39.450186 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296518 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 02:16:39.450186 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296521 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 02:16:39.450186 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296525 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 02:16:39.450186 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296527 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 02:16:39.451308 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296530 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 02:16:39.451308 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296533 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 02:16:39.451308 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296535 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 02:16:39.451308 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296537 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 02:16:39.451308 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296540 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 02:16:39.451308 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296543 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 02:16:39.451308 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296545 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 02:16:39.451308 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296548 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 02:16:39.451308 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296550 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 02:16:39.451308 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296553 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 02:16:39.451308 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296555 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 02:16:39.451308 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296558 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 02:16:39.451308 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296560 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 02:16:39.451308 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296563 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 02:16:39.451308 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296567 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 02:16:39.451308 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296570 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 02:16:39.451308 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296573 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 02:16:39.451308 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296577 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 02:16:39.451308 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296580 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 02:16:39.452474 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296582 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 02:16:39.452474 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296585 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 02:16:39.452474 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296588 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 02:16:39.452474 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296590 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 02:16:39.452474 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296593 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 02:16:39.452474 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296596 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 02:16:39.452474 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296598 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 02:16:39.452474 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296601 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 02:16:39.452474 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296603 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 02:16:39.452474 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296606 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 02:16:39.452474 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296608 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 02:16:39.452474 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296612 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 02:16:39.452474 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296614 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 02:16:39.452474 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296618 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 22 02:16:39.452474 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296620 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 02:16:39.452474 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296622 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 02:16:39.452474 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296625 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 02:16:39.452474 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296628 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 02:16:39.452474 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296631 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 02:16:39.452474 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296633 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 02:16:39.453184 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296652 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 02:16:39.453184 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296655 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 02:16:39.453184 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296658 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 02:16:39.453184 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296661 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 02:16:39.453184 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296663 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 02:16:39.453184 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296666 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 02:16:39.453184 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296668 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 02:16:39.453184 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296673 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 02:16:39.453184 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296675 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 02:16:39.453184 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296678 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 02:16:39.453184 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296681 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 02:16:39.453184 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296683 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 02:16:39.453184 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296686 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 02:16:39.453184 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296688 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 02:16:39.453184 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296691 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 02:16:39.453184 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296693 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 02:16:39.453184 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296696 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 02:16:39.453184 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296700 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 02:16:39.453184 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296703 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 02:16:39.453184 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.296706 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 02:16:39.454120 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.296711 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 02:16:39.454120 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.311501 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 22 02:16:39.454120 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.311523 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 22 02:16:39.454120 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.312217 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 22 02:16:39.454120 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.312226 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 22 02:16:39.454120 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312291 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 02:16:39.454120 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312296 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 02:16:39.454120 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312300 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 02:16:39.454120 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312303 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 02:16:39.454120 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312306 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 02:16:39.454120 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312309 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 02:16:39.454120 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312311 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 02:16:39.454120 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312314 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 02:16:39.454120 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312317 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 02:16:39.454847 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312320 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 02:16:39.454847 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312322 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 02:16:39.454847 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312325 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 02:16:39.454847 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312327 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 02:16:39.454847 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312330 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 02:16:39.454847 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312332 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 02:16:39.454847 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312335 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 02:16:39.454847 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312338 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 02:16:39.454847 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312340 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 02:16:39.454847 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312342 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 02:16:39.454847 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312345 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 02:16:39.454847 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312349 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 02:16:39.454847 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312354 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 02:16:39.454847 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312357 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 02:16:39.454847 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312361 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 02:16:39.454847 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312364 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 02:16:39.454847 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312366 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 02:16:39.454847 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312369 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 22 02:16:39.454847 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312373 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 02:16:39.455813 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312376 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 02:16:39.455813 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312385 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 02:16:39.455813 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312389 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 02:16:39.455813 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312392 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 02:16:39.455813 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312395 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 02:16:39.455813 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312397 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 02:16:39.455813 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312400 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 02:16:39.455813 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312403 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 02:16:39.455813 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312405 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 02:16:39.455813 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312407 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 02:16:39.455813 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312410 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 02:16:39.455813 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312412 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 02:16:39.455813 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312415 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 02:16:39.455813 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312418 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 02:16:39.455813 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312420 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 02:16:39.455813 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312423 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 02:16:39.455813 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312425 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 02:16:39.455813 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312428 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 02:16:39.455813 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312431 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 02:16:39.455813 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312433 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 02:16:39.456688 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312436 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 02:16:39.456688 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312438 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 02:16:39.456688 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312441 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 02:16:39.456688 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312443 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 02:16:39.456688 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312446 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 02:16:39.456688 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312448 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 02:16:39.456688 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312450 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 02:16:39.456688 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312453 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 02:16:39.456688 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312459 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 02:16:39.456688 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312462 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 02:16:39.456688 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312464 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 02:16:39.456688 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312467 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 02:16:39.456688 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312469 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 02:16:39.456688 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312473 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 02:16:39.456688 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312481 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 02:16:39.456688 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312484 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 02:16:39.456688 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312486 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 02:16:39.456688 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312489 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 02:16:39.456688 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312491 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 02:16:39.456688 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312494 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 02:16:39.457624 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312497 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 02:16:39.457624 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312499 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 02:16:39.457624 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312502 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 02:16:39.457624 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312504 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 02:16:39.457624 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312507 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 02:16:39.457624 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312509 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 02:16:39.457624 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312512 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 02:16:39.457624 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312514 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 02:16:39.457624 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312517 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 02:16:39.457624 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312520 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 02:16:39.457624 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312522 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 02:16:39.457624 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312525 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 02:16:39.457624 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312527 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 02:16:39.457624 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312530 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 02:16:39.457624 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312533 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 02:16:39.457624 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312535 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 02:16:39.457624 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312538 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 02:16:39.457624 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312540 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 02:16:39.457624 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312543 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 02:16:39.457624 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312546 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 02:16:39.458410 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312549 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 02:16:39.458410 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312552 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 02:16:39.458410 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312555 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 02:16:39.458410 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312557 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 02:16:39.458410 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312560 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 02:16:39.458410 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312563 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 02:16:39.458410 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312565 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 02:16:39.458410 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312575 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 02:16:39.458410 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312577 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 02:16:39.458410 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312582 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 02:16:39.458410 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312584 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 02:16:39.458410 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.312589 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 02:16:39.458410 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312782 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 02:16:39.458410 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312796 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 02:16:39.458410 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312799 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 02:16:39.458928 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312803 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 02:16:39.458928 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312806 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 02:16:39.458928 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312809 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 02:16:39.458928 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312812 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 02:16:39.458928 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312814 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 02:16:39.458928 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312817 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 02:16:39.458928 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312820 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 02:16:39.458928 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312822 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 02:16:39.458928 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312825 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 02:16:39.458928 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312828 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 02:16:39.458928 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312836 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 02:16:39.458928 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312839 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 02:16:39.458928 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312841 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 02:16:39.458928 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312844 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 02:16:39.458928 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312847 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 02:16:39.458928 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312851 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 22 02:16:39.458928 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312854 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 02:16:39.458928 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312857 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 02:16:39.458928 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312860 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 02:16:39.458928 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312863 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 02:16:39.459548 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312867 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 02:16:39.459548 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312871 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 02:16:39.459548 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312873 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 02:16:39.459548 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312876 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 02:16:39.459548 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312880 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 02:16:39.459548 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312888 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 02:16:39.459548 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312891 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 02:16:39.459548 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312894 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 02:16:39.459548 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312896 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 02:16:39.459548 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312898 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 02:16:39.459548 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312901 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 02:16:39.459548 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312904 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 02:16:39.459548 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312906 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 02:16:39.459548 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312909 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 02:16:39.459548 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312912 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 02:16:39.459548 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312914 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 02:16:39.459548 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312918 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 02:16:39.459548 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312922 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 02:16:39.459548 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312925 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 02:16:39.460125 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312928 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 02:16:39.460125 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312931 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 02:16:39.460125 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312933 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 02:16:39.460125 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312936 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 02:16:39.460125 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312939 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 02:16:39.460125 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312942 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 02:16:39.460125 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312944 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 02:16:39.460125 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312947 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 02:16:39.460125 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312951 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 02:16:39.460125 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312953 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 02:16:39.460125 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312956 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 02:16:39.460125 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312958 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 02:16:39.460125 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312961 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 02:16:39.460125 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312963 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 02:16:39.460125 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312966 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 02:16:39.460125 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312968 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 02:16:39.460125 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312971 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 02:16:39.460125 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312975 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 02:16:39.460125 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312977 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 02:16:39.460863 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312987 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 02:16:39.460863 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312989 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 02:16:39.460863 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312992 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 02:16:39.460863 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312994 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 02:16:39.460863 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312997 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 02:16:39.460863 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.312999 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 02:16:39.460863 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313002 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 02:16:39.460863 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313004 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 02:16:39.460863 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313007 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 02:16:39.460863 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313009 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 02:16:39.460863 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313012 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 02:16:39.460863 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313014 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 02:16:39.460863 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313017 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 02:16:39.460863 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313019 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 02:16:39.460863 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313021 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 02:16:39.460863 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313024 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 02:16:39.460863 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313027 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 02:16:39.460863 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313029 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 02:16:39.460863 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313032 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 02:16:39.460863 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313034 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 02:16:39.461569 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313037 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 02:16:39.461569 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313041 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 02:16:39.461569 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313044 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 02:16:39.461569 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313048 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 02:16:39.461569 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313051 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 02:16:39.461569 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313054 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 02:16:39.461569 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313057 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 02:16:39.461569 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313059 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 02:16:39.461569 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313062 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 02:16:39.461569 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313065 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 02:16:39.461569 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313069 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 02:16:39.461569 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313073 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 02:16:39.461569 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313076 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 02:16:39.461569 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313085 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 02:16:39.461569 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313088 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 02:16:39.461569 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313090 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 02:16:39.461569 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313093 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 02:16:39.461569 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:39.313095 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 02:16:39.462284 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.313101 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 02:16:39.462284 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.313221 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 22 02:16:39.462284 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.322061 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 22 02:16:39.462284 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.323401 2556 server.go:1019] "Starting client certificate rotation" Jul 22 02:16:39.462284 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.323527 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 02:16:39.462284 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.323587 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 02:16:39.462284 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.326701 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 02:16:39.462284 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.331161 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 02:16:39.462284 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.358056 2556 log.go:25] "Validated CRI v1 runtime API" Jul 22 02:16:39.462284 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.370760 2556 log.go:25] "Validated CRI v1 image API" Jul 22 02:16:39.462284 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.371659 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 22 02:16:39.462284 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.374056 2556 fs.go:135] Filesystem UUIDs: map[730c4655-50a2-41a0-8b39-9216a65fa17e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 899461a0-8360-48c7-8026-ad905673feb8:/dev/nvme0n1p3] Jul 22 02:16:39.462994 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.374072 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 22 02:16:39.462994 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.376143 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 02:16:39.462994 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.393764 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8hkm2" Jul 22 02:16:39.462994 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.401096 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8hkm2" Jul 22 02:16:39.465558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.418243 2556 manager.go:216] Machine: {Timestamp:2026-07-22 02:16:39.378906717 +0000 UTC m=+0.487326047 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104832 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d10b2c8b64398c1a33a1b94aa10b0 SystemUUID:ec2d10b2-c8b6-4398-c1a3-3a1b94aa10b0 BootID:261713b6-e471-4c31-a593-366b94b70d51 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ef:12:f0:5e:4b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ef:12:f0:5e:4b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:c3:8a:25:ac:3e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 22 02:16:39.465558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.418355 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 22 02:16:39.465558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.418494 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 22 02:16:39.465558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.421535 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 22 02:16:39.465558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.421563 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-41.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 22 02:16:39.465558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.422296 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 22 02:16:39.465558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.422307 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 22 02:16:39.465558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.422314 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 02:16:39.465558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.422837 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 02:16:39.465558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.424196 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 22 02:16:39.465558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.426770 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 22 02:16:39.465558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.426898 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 22 02:16:39.465558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.426928 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 22 02:16:39.465558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.426941 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 22 02:16:39.465558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.426958 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 22 02:16:39.465558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.426989 2556 kubelet.go:398] "Adding apiserver pod source" Jul 22 02:16:39.465558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.427005 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 22 02:16:39.465558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.427446 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 02:16:39.466243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.427469 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 02:16:39.466243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.429432 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 22 02:16:39.466243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.447133 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 02:16:39.466243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.455325 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 22 02:16:39.466243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.455395 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 22 02:16:39.466243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.457316 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 22 02:16:39.466243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.457390 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 22 02:16:39.466243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.457401 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 22 02:16:39.466243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.457409 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 22 02:16:39.466243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.457420 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 22 02:16:39.466243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.457427 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 22 02:16:39.466243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.457436 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 22 02:16:39.466243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.457443 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 22 02:16:39.466243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.457452 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 22 02:16:39.466243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.457459 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 22 02:16:39.466243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.457472 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 22 02:16:39.466243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.457479 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 22 02:16:39.466243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.458025 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 02:16:39.466243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.458485 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 22 02:16:39.466243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.458599 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 22 02:16:39.529138 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.528168 2556 server.go:1268] "Started kubelet" Jul 22 02:16:39.529138 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.528277 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 22 02:16:39.529138 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.528277 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 22 02:16:39.529138 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.528463 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 22 02:16:39.530295 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.529746 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 22 02:16:39.529413 ip-10-0-137-41 systemd[1]: Started Kubernetes Kubelet. Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.535632 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:39.538511 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.541335 2556 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-41.ec2.internal" not found Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.549238 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.549245 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:39.549352 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-41.ec2.internal\" not found" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.549875 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.549886 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.549900 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.549980 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.549991 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.550127 2556 factory.go:55] Registering systemd factory Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.550145 2556 factory.go:223] Registration of the systemd container factory successfully Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.550413 2556 factory.go:153] Registering CRI-O factory Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.550429 2556 factory.go:223] Registration of the crio container factory successfully Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.550483 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.550509 2556 factory.go:103] Registering Raw factory Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.550522 2556 manager.go:1196] Started watching for new ooms in manager Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.550987 2556 manager.go:349] Starting recovery of all containers Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.552003 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:39.555633 2556 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-41.ec2.internal\" not found" node="ip-10-0-137-41.ec2.internal" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.558053 2556 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-41.ec2.internal" not found Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.565031 2556 manager.go:354] Recovery completed Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.575212 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.577458 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-41.ec2.internal" event="NodeHasSufficientMemory" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.577488 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-41.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.577504 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-41.ec2.internal" event="NodeHasSufficientPID" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.578083 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.578097 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.578120 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.578089 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.578897 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-41.ec2.internal" event="NodeHasSufficientMemory" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.578923 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-41.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.578934 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-41.ec2.internal" event="NodeHasSufficientPID" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.583838 2556 policy_none.go:49] "None policy: Start" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.583853 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.583863 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.585096 2556 policy_none.go:47] "Start" Jul 22 02:16:39.618857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.614875 2556 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-41.ec2.internal" not found Jul 22 02:16:39.731892 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:39.659999 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-41.ec2.internal\" not found" Jul 22 02:16:39.731892 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.693611 2556 manager.go:337] "Starting Device Plugin manager" Jul 22 02:16:39.731892 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:39.693841 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 22 02:16:39.731892 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.693857 2556 server.go:87] "Starting device plugin registration server" Jul 22 02:16:39.731892 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.694156 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 22 02:16:39.731892 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.694168 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 22 02:16:39.731892 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.694286 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 22 02:16:39.731892 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.694390 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 22 02:16:39.731892 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.694399 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 22 02:16:39.731892 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:39.695020 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 22 02:16:39.731892 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:39.695070 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-41.ec2.internal\" not found" Jul 22 02:16:39.867214 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.794580 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 02:16:39.867214 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.795935 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-41.ec2.internal" event="NodeHasSufficientMemory" Jul 22 02:16:39.867214 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.795969 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-41.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 02:16:39.867214 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.795983 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-41.ec2.internal" event="NodeHasSufficientPID" Jul 22 02:16:39.867214 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.796012 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-41.ec2.internal" Jul 22 02:16:39.873390 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.872198 2556 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-41.ec2.internal" not found Jul 22 02:16:39.873390 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:39.872273 2556 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-137-41.ec2.internal" not found Jul 22 02:16:39.993004 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.910925 2556 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-41.ec2.internal" not found Jul 22 02:16:39.993004 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.928000 2556 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-41.ec2.internal" not found Jul 22 02:16:39.993004 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:39.987592 2556 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-41.ec2.internal" not found Jul 22 02:16:40.171246 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.171221 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-41.ec2.internal" Jul 22 02:16:40.246747 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.246704 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 22 02:16:40.248006 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.247973 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 22 02:16:40.248131 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.248030 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 22 02:16:40.248131 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.248060 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 22 02:16:40.248131 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:40.248105 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 22 02:16:40.250612 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.250589 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 02:16:40.324041 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.324005 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 22 02:16:40.324236 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.324182 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 02:16:40.324236 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.324200 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 02:16:40.324236 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.324221 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 02:16:40.348806 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.348771 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-41.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal"] Jul 22 02:16:40.350879 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.350862 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-41.ec2.internal" Jul 22 02:16:40.351956 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.351932 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal" Jul 22 02:16:40.363764 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.363736 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a2b0b0078cc79ecb5329ccfa51d0dad-config\") pod \"kube-apiserver-proxy-ip-10-0-137-41.ec2.internal\" (UID: \"0a2b0b0078cc79ecb5329ccfa51d0dad\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-41.ec2.internal" Jul 22 02:16:40.376481 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.376463 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-41.ec2.internal" Jul 22 02:16:40.381229 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.381213 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal" Jul 22 02:16:40.386306 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.386291 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 02:16:40.393568 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.393553 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 02:16:40.405579 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.405536 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 02:11:39 +0000 UTC" deadline="2027-12-30 18:45:09.042807311 +0000 UTC" Jul 22 02:16:40.405579 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.405575 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12640h28m28.637234982s" Jul 22 02:16:40.427197 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.427114 2556 apiserver.go:52] "Watching apiserver" Jul 22 02:16:40.436502 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.436483 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 22 02:16:40.436880 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.436861 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-41.ec2.internal","openshift-cluster-node-tuning-operator/tuned-c9w8w","openshift-image-registry/node-ca-9r7nk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal","openshift-network-operator/iptables-alerter-bmwlm","openshift-ovn-kubernetes/ovnkube-node-zn9wn","kube-system/global-pull-secret-syncer-rxh5h","kube-system/konnectivity-agent-pqx7f","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w","openshift-dns/node-resolver-5bgxb","openshift-multus/multus-2wwsz","openshift-multus/multus-additional-cni-plugins-cnvr9","openshift-multus/network-metrics-daemon-hmqt5","openshift-network-diagnostics/network-check-target-548xn"] Jul 22 02:16:40.438327 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.438312 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.439990 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.439973 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9r7nk" Jul 22 02:16:40.441165 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.441128 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bmwlm" Jul 22 02:16:40.441559 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.441544 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 22 02:16:40.441559 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.441551 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4rmgv\"" Jul 22 02:16:40.441986 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.441970 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 22 02:16:40.442368 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.442355 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.442918 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.442901 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 22 02:16:40.443534 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.443510 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 22 02:16:40.443534 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.443527 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 22 02:16:40.444239 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.444207 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:40.444341 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:40.444309 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:16:40.444444 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.444422 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mgp4t\"" Jul 22 02:16:40.444530 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.444512 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 22 02:16:40.445123 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.445100 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 22 02:16:40.445222 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.445156 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 22 02:16:40.445222 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.445186 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h2cjg\"" Jul 22 02:16:40.446554 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.446524 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pqx7f" Jul 22 02:16:40.446634 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.446610 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 22 02:16:40.446706 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.446661 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 22 02:16:40.446865 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.446802 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x7whw\"" Jul 22 02:16:40.446972 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.446954 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 22 02:16:40.446972 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.446962 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 22 02:16:40.447326 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.447308 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 22 02:16:40.447615 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.447593 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 22 02:16:40.447756 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.447691 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.449157 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.449139 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l4fjd\"" Jul 22 02:16:40.449329 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.449312 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 22 02:16:40.449803 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.449788 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 22 02:16:40.449884 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.449871 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5bgxb" Jul 22 02:16:40.451180 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.451165 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 22 02:16:40.451241 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.451197 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.451421 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.451406 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 22 02:16:40.451701 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.451684 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8sfsg\"" Jul 22 02:16:40.452764 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.452704 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 22 02:16:40.452764 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.452736 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.452939 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.452736 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 22 02:16:40.452939 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.452830 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6l9d4\"" Jul 22 02:16:40.453158 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.453144 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 22 02:16:40.453997 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.453977 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:16:40.454073 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:40.454050 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:16:40.454404 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.454385 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 22 02:16:40.454465 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.454440 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 22 02:16:40.454518 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.454475 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 22 02:16:40.454518 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.454485 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 22 02:16:40.454518 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.454484 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8rmtw\"" Jul 22 02:16:40.455354 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.455335 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:16:40.455445 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:40.455396 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:16:40.455868 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.455853 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 22 02:16:40.456006 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.455992 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 22 02:16:40.456284 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.456271 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vr886\"" Jul 22 02:16:40.463914 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.463892 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-modprobe-d\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.463985 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.463926 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-run-openvswitch\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.463985 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.463953 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1e145c77-ffbb-4a29-8b35-d7c949a16215-env-overrides\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.463985 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.463977 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-host-run-k8s-cni-cncf-io\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.464091 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464021 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-multus-daemon-config\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.464091 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464049 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hctg4\" (UniqueName: \"kubernetes.io/projected/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-kube-api-access-hctg4\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.464091 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464065 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-sysconfig\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.464230 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464089 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hcff\" (UniqueName: \"kubernetes.io/projected/19b441a9-443f-4cac-8a30-d9fd5e4a4cca-kube-api-access-5hcff\") pod \"node-ca-9r7nk\" (UID: \"19b441a9-443f-4cac-8a30-d9fd5e4a4cca\") " pod="openshift-image-registry/node-ca-9r7nk" Jul 22 02:16:40.464230 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464143 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f25eed9e-6c88-419b-a963-9097079cf48c-etc-selinux\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.464230 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464182 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-cni-bin\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.464230 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464209 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365-hosts-file\") pod \"node-resolver-5bgxb\" (UID: \"74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365\") " pod="openshift-dns/node-resolver-5bgxb" Jul 22 02:16:40.464433 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464233 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-cnibin\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.464433 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464261 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-multus-socket-dir-parent\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.464433 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464289 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-host-run-netns\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.464433 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464327 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-run-netns\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.464433 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464352 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-cni-binary-copy\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.464433 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464377 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-host-var-lib-cni-bin\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.464433 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464402 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-host-run-multus-certs\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.464433 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464430 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-etc-kubernetes\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.464849 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464461 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret\") pod \"global-pull-secret-syncer-rxh5h\" (UID: \"7f8aa8dc-6c8f-4e21-84be-429e861b5fa0\") " pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:40.464849 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464487 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kccv\" (UniqueName: \"kubernetes.io/projected/f25eed9e-6c88-419b-a963-9097079cf48c-kube-api-access-2kccv\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.464849 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464513 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e145c77-ffbb-4a29-8b35-d7c949a16215-ovn-node-metrics-cert\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.464849 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464544 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-var-lib-kubelet\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.464849 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464569 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-host\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.464849 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464594 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-cni-netd\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.464849 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464616 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365-tmp-dir\") pod \"node-resolver-5bgxb\" (UID: \"74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365\") " pod="openshift-dns/node-resolver-5bgxb" Jul 22 02:16:40.464849 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464666 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-system-cni-dir\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.464849 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464688 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-host-var-lib-kubelet\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.464849 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464706 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-hostroot\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.464849 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464721 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-sysctl-d\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.464849 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464737 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snslt\" (UniqueName: \"kubernetes.io/projected/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-kube-api-access-snslt\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.464849 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464779 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-kubernetes\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.464849 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464807 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f25eed9e-6c88-419b-a963-9097079cf48c-socket-dir\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.464849 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464843 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f25eed9e-6c88-419b-a963-9097079cf48c-device-dir\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.465385 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464886 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-var-lib-openvswitch\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.465385 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464918 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-multus-cni-dir\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.465385 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464944 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f25eed9e-6c88-419b-a963-9097079cf48c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.465385 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464967 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-etc-openvswitch\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.465385 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.464992 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fkrw\" (UniqueName: \"kubernetes.io/projected/1e145c77-ffbb-4a29-8b35-d7c949a16215-kube-api-access-9fkrw\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.465385 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465026 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a2b0b0078cc79ecb5329ccfa51d0dad-config\") pod \"kube-apiserver-proxy-ip-10-0-137-41.ec2.internal\" (UID: \"0a2b0b0078cc79ecb5329ccfa51d0dad\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-41.ec2.internal" Jul 22 02:16:40.465385 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465048 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-tmp\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.465385 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465060 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a2b0b0078cc79ecb5329ccfa51d0dad-config\") pod \"kube-apiserver-proxy-ip-10-0-137-41.ec2.internal\" (UID: \"0a2b0b0078cc79ecb5329ccfa51d0dad\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-41.ec2.internal" Jul 22 02:16:40.465385 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465072 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-run-ovn\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.465385 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465098 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6afb404db9de437e9c415b35d8e765f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal\" (UID: \"f6afb404db9de437e9c415b35d8e765f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal" Jul 22 02:16:40.465385 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465133 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-tuned\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.465385 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465148 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-dbus\") pod \"global-pull-secret-syncer-rxh5h\" (UID: \"7f8aa8dc-6c8f-4e21-84be-429e861b5fa0\") " pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:40.465385 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465162 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-log-socket\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.465385 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465189 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k265n\" (UniqueName: \"kubernetes.io/projected/74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365-kube-api-access-k265n\") pod \"node-resolver-5bgxb\" (UID: \"74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365\") " pod="openshift-dns/node-resolver-5bgxb" Jul 22 02:16:40.465385 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465222 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9099cc96-5e4a-490d-8118-171b1eba8b6d-iptables-alerter-script\") pod \"iptables-alerter-bmwlm\" (UID: \"9099cc96-5e4a-490d-8118-171b1eba8b6d\") " pod="openshift-network-operator/iptables-alerter-bmwlm" Jul 22 02:16:40.465385 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465244 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/241b6cf2-254d-4233-8d0a-0b373bd1236d-agent-certs\") pod \"konnectivity-agent-pqx7f\" (UID: \"241b6cf2-254d-4233-8d0a-0b373bd1236d\") " pod="kube-system/konnectivity-agent-pqx7f" Jul 22 02:16:40.466095 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465263 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-slash\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.466095 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465278 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-run-ovn-kubernetes\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.466095 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465292 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6afb404db9de437e9c415b35d8e765f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal\" (UID: \"f6afb404db9de437e9c415b35d8e765f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal" Jul 22 02:16:40.466095 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465307 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-sysctl-conf\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.466095 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465339 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-sys\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.466095 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465369 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9099cc96-5e4a-490d-8118-171b1eba8b6d-host-slash\") pod \"iptables-alerter-bmwlm\" (UID: \"9099cc96-5e4a-490d-8118-171b1eba8b6d\") " pod="openshift-network-operator/iptables-alerter-bmwlm" Jul 22 02:16:40.466095 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465416 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-kubelet-config\") pod \"global-pull-secret-syncer-rxh5h\" (UID: \"7f8aa8dc-6c8f-4e21-84be-429e861b5fa0\") " pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:40.466095 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465435 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-os-release\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.466095 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465452 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-host-var-lib-cni-multus\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.466095 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465467 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-lib-modules\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.466095 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465483 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/241b6cf2-254d-4233-8d0a-0b373bd1236d-konnectivity-ca\") pod \"konnectivity-agent-pqx7f\" (UID: \"241b6cf2-254d-4233-8d0a-0b373bd1236d\") " pod="kube-system/konnectivity-agent-pqx7f" Jul 22 02:16:40.466095 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465518 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-kubelet\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.466095 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465560 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-systemd\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.466095 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465584 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-run\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.466095 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465607 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19b441a9-443f-4cac-8a30-d9fd5e4a4cca-host\") pod \"node-ca-9r7nk\" (UID: \"19b441a9-443f-4cac-8a30-d9fd5e4a4cca\") " pod="openshift-image-registry/node-ca-9r7nk" Jul 22 02:16:40.466095 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465631 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-node-log\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.466095 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465689 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1e145c77-ffbb-4a29-8b35-d7c949a16215-ovnkube-script-lib\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.466581 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465715 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19b441a9-443f-4cac-8a30-d9fd5e4a4cca-serviceca\") pod \"node-ca-9r7nk\" (UID: \"19b441a9-443f-4cac-8a30-d9fd5e4a4cca\") " pod="openshift-image-registry/node-ca-9r7nk" Jul 22 02:16:40.466581 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465741 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f25eed9e-6c88-419b-a963-9097079cf48c-registration-dir\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.466581 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465765 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f25eed9e-6c88-419b-a963-9097079cf48c-sys-fs\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.466581 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465787 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-systemd-units\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.466581 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465805 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1e145c77-ffbb-4a29-8b35-d7c949a16215-ovnkube-config\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.466581 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465833 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-multus-conf-dir\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.466581 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465860 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njpjx\" (UniqueName: \"kubernetes.io/projected/9099cc96-5e4a-490d-8118-171b1eba8b6d-kube-api-access-njpjx\") pod \"iptables-alerter-bmwlm\" (UID: \"9099cc96-5e4a-490d-8118-171b1eba8b6d\") " pod="openshift-network-operator/iptables-alerter-bmwlm" Jul 22 02:16:40.466581 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465885 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-run-systemd\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.466581 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.465919 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.550099 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.550072 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 22 02:16:40.550729 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.550709 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 22 02:16:40.564836 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.564811 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 02:16:40.566631 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.566609 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-lib-modules\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.566699 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.566644 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/241b6cf2-254d-4233-8d0a-0b373bd1236d-konnectivity-ca\") pod \"konnectivity-agent-pqx7f\" (UID: \"241b6cf2-254d-4233-8d0a-0b373bd1236d\") " pod="kube-system/konnectivity-agent-pqx7f" Jul 22 02:16:40.566699 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.566681 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-kubelet\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.566813 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.566698 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-systemd\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.566813 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.566714 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-run\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.566813 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.566730 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19b441a9-443f-4cac-8a30-d9fd5e4a4cca-host\") pod \"node-ca-9r7nk\" (UID: \"19b441a9-443f-4cac-8a30-d9fd5e4a4cca\") " pod="openshift-image-registry/node-ca-9r7nk" Jul 22 02:16:40.566813 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.566752 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-node-log\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.566813 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.566754 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-lib-modules\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.566813 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.566777 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1e145c77-ffbb-4a29-8b35-d7c949a16215-ovnkube-script-lib\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.566813 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.566787 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-kubelet\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.567151 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.566820 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-systemd\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.567151 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.566824 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19b441a9-443f-4cac-8a30-d9fd5e4a4cca-host\") pod \"node-ca-9r7nk\" (UID: \"19b441a9-443f-4cac-8a30-d9fd5e4a4cca\") " pod="openshift-image-registry/node-ca-9r7nk" Jul 22 02:16:40.567151 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.566848 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19b441a9-443f-4cac-8a30-d9fd5e4a4cca-serviceca\") pod \"node-ca-9r7nk\" (UID: \"19b441a9-443f-4cac-8a30-d9fd5e4a4cca\") " pod="openshift-image-registry/node-ca-9r7nk" Jul 22 02:16:40.567151 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.566823 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-node-log\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.567151 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.566888 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f25eed9e-6c88-419b-a963-9097079cf48c-registration-dir\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.567151 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.566919 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f25eed9e-6c88-419b-a963-9097079cf48c-sys-fs\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.567151 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.566946 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-systemd-units\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.567151 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.566970 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1e145c77-ffbb-4a29-8b35-d7c949a16215-ovnkube-config\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.567151 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.566997 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-multus-conf-dir\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.567151 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567018 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f25eed9e-6c88-419b-a963-9097079cf48c-sys-fs\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.567151 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567019 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-run\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.567151 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567027 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfs2d\" (UniqueName: \"kubernetes.io/projected/c581daf0-338d-43d1-923f-6283ebe6405a-kube-api-access-zfs2d\") pod \"network-metrics-daemon-hmqt5\" (UID: \"c581daf0-338d-43d1-923f-6283ebe6405a\") " pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:16:40.567151 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567072 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-systemd-units\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.567789 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567166 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njpjx\" (UniqueName: \"kubernetes.io/projected/9099cc96-5e4a-490d-8118-171b1eba8b6d-kube-api-access-njpjx\") pod \"iptables-alerter-bmwlm\" (UID: \"9099cc96-5e4a-490d-8118-171b1eba8b6d\") " pod="openshift-network-operator/iptables-alerter-bmwlm" Jul 22 02:16:40.567789 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567185 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f25eed9e-6c88-419b-a963-9097079cf48c-registration-dir\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.567789 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567239 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-multus-conf-dir\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.567789 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567283 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-run-systemd\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.567789 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567319 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.567789 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567345 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19b441a9-443f-4cac-8a30-d9fd5e4a4cca-serviceca\") pod \"node-ca-9r7nk\" (UID: \"19b441a9-443f-4cac-8a30-d9fd5e4a4cca\") " pod="openshift-image-registry/node-ca-9r7nk" Jul 22 02:16:40.567789 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567358 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km5xs\" (UniqueName: \"kubernetes.io/projected/88ba46ca-7b85-49ff-a952-f5e94af52408-kube-api-access-km5xs\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.567789 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567392 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-modprobe-d\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.567789 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567407 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-run-systemd\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.567789 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567419 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-run-openvswitch\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.567789 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567445 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1e145c77-ffbb-4a29-8b35-d7c949a16215-env-overrides\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.567789 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567461 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.567789 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567469 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-host-run-k8s-cni-cncf-io\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.567789 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567473 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/241b6cf2-254d-4233-8d0a-0b373bd1236d-konnectivity-ca\") pod \"konnectivity-agent-pqx7f\" (UID: \"241b6cf2-254d-4233-8d0a-0b373bd1236d\") " pod="kube-system/konnectivity-agent-pqx7f" Jul 22 02:16:40.567789 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567506 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-run-openvswitch\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.567789 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567510 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1e145c77-ffbb-4a29-8b35-d7c949a16215-ovnkube-script-lib\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.567789 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567524 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-modprobe-d\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.568472 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567536 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-multus-daemon-config\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.568472 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567541 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-host-run-k8s-cni-cncf-io\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.568472 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567562 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hctg4\" (UniqueName: \"kubernetes.io/projected/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-kube-api-access-hctg4\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.568472 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567596 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88ba46ca-7b85-49ff-a952-f5e94af52408-cnibin\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.568472 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567620 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-sysconfig\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.568472 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567668 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1e145c77-ffbb-4a29-8b35-d7c949a16215-ovnkube-config\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.568472 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567692 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hcff\" (UniqueName: \"kubernetes.io/projected/19b441a9-443f-4cac-8a30-d9fd5e4a4cca-kube-api-access-5hcff\") pod \"node-ca-9r7nk\" (UID: \"19b441a9-443f-4cac-8a30-d9fd5e4a4cca\") " pod="openshift-image-registry/node-ca-9r7nk" Jul 22 02:16:40.568472 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567720 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f25eed9e-6c88-419b-a963-9097079cf48c-etc-selinux\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.568472 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567740 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-cni-bin\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.568472 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567742 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-sysconfig\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.568472 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567786 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365-hosts-file\") pod \"node-resolver-5bgxb\" (UID: \"74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365\") " pod="openshift-dns/node-resolver-5bgxb" Jul 22 02:16:40.568472 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567803 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-cni-bin\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.568472 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567818 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-cnibin\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.568472 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567850 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-multus-socket-dir-parent\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.568472 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567863 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365-hosts-file\") pod \"node-resolver-5bgxb\" (UID: \"74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365\") " pod="openshift-dns/node-resolver-5bgxb" Jul 22 02:16:40.568472 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567870 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-cnibin\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.568472 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567885 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f25eed9e-6c88-419b-a963-9097079cf48c-etc-selinux\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.568472 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567899 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1e145c77-ffbb-4a29-8b35-d7c949a16215-env-overrides\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.569250 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567884 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-host-run-netns\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.569250 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567920 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-host-run-netns\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.569250 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567940 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-multus-socket-dir-parent\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.569250 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567955 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-run-netns\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.569250 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.567986 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-cni-binary-copy\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.569250 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568012 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-run-netns\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.569250 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568055 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-host-var-lib-cni-bin\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.569250 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568078 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-host-run-multus-certs\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.569250 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568108 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-host-var-lib-cni-bin\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.569250 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568130 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-multus-daemon-config\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.569250 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568151 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-etc-kubernetes\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.569250 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568162 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-host-run-multus-certs\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.569250 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568203 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret\") pod \"global-pull-secret-syncer-rxh5h\" (UID: \"7f8aa8dc-6c8f-4e21-84be-429e861b5fa0\") " pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:40.569250 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568231 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kccv\" (UniqueName: \"kubernetes.io/projected/f25eed9e-6c88-419b-a963-9097079cf48c-kube-api-access-2kccv\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.569250 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568259 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e145c77-ffbb-4a29-8b35-d7c949a16215-ovn-node-metrics-cert\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.569250 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:40.568281 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:40.569250 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568314 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88ba46ca-7b85-49ff-a952-f5e94af52408-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.569250 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568362 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-etc-kubernetes\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.570144 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:40.568376 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret podName:7f8aa8dc-6c8f-4e21-84be-429e861b5fa0 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:41.068336288 +0000 UTC m=+2.176755623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret") pod "global-pull-secret-syncer-rxh5h" (UID: "7f8aa8dc-6c8f-4e21-84be-429e861b5fa0") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:40.570144 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568397 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-var-lib-kubelet\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.570144 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568453 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-host\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.570144 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568504 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-var-lib-kubelet\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.570144 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568552 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-cni-binary-copy\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.570144 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568567 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-cni-netd\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.570144 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568578 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-host\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.570144 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568620 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365-tmp-dir\") pod \"node-resolver-5bgxb\" (UID: \"74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365\") " pod="openshift-dns/node-resolver-5bgxb" Jul 22 02:16:40.570144 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568640 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-cni-netd\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.570144 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568683 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-system-cni-dir\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.570144 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568687 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 22 02:16:40.570144 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568714 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-host-var-lib-kubelet\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.570144 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568738 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-hostroot\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.570144 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568765 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-host-var-lib-kubelet\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.570144 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568767 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq2d5\" (UniqueName: \"kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5\") pod \"network-check-target-548xn\" (UID: \"78545e6e-eee9-4191-a1d3-66ef62a849c6\") " pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:16:40.570144 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568790 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-system-cni-dir\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.570144 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568803 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-hostroot\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.570680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568815 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-sysctl-d\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.570680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568842 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snslt\" (UniqueName: \"kubernetes.io/projected/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-kube-api-access-snslt\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.570680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568851 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365-tmp-dir\") pod \"node-resolver-5bgxb\" (UID: \"74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365\") " pod="openshift-dns/node-resolver-5bgxb" Jul 22 02:16:40.570680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568868 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88ba46ca-7b85-49ff-a952-f5e94af52408-system-cni-dir\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.570680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568890 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88ba46ca-7b85-49ff-a952-f5e94af52408-os-release\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.570680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568906 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-kubernetes\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.570680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568943 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f25eed9e-6c88-419b-a963-9097079cf48c-socket-dir\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.570680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568963 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f25eed9e-6c88-419b-a963-9097079cf48c-device-dir\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.570680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568967 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-kubernetes\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.570680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568982 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-var-lib-openvswitch\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.570680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568988 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-sysctl-d\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.570680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.568999 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-multus-cni-dir\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.570680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569026 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f25eed9e-6c88-419b-a963-9097079cf48c-device-dir\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.570680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569033 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88ba46ca-7b85-49ff-a952-f5e94af52408-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.570680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569052 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-multus-cni-dir\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.570680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569058 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f25eed9e-6c88-419b-a963-9097079cf48c-socket-dir\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.570680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569066 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f25eed9e-6c88-419b-a963-9097079cf48c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.571306 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569072 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-var-lib-openvswitch\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.571306 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569091 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-etc-openvswitch\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.571306 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569108 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fkrw\" (UniqueName: \"kubernetes.io/projected/1e145c77-ffbb-4a29-8b35-d7c949a16215-kube-api-access-9fkrw\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.571306 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569127 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs\") pod \"network-metrics-daemon-hmqt5\" (UID: \"c581daf0-338d-43d1-923f-6283ebe6405a\") " pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:16:40.571306 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569142 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-etc-openvswitch\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.571306 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569149 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-tmp\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.571306 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569108 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f25eed9e-6c88-419b-a963-9097079cf48c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.571306 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569167 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-run-ovn\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.571306 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569195 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6afb404db9de437e9c415b35d8e765f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal\" (UID: \"f6afb404db9de437e9c415b35d8e765f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal" Jul 22 02:16:40.571306 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569198 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-run-ovn\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.571306 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569217 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-tuned\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.571306 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569237 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6afb404db9de437e9c415b35d8e765f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal\" (UID: \"f6afb404db9de437e9c415b35d8e765f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal" Jul 22 02:16:40.571306 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569245 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-dbus\") pod \"global-pull-secret-syncer-rxh5h\" (UID: \"7f8aa8dc-6c8f-4e21-84be-429e861b5fa0\") " pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:40.571306 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569266 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-log-socket\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.571306 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569283 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k265n\" (UniqueName: \"kubernetes.io/projected/74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365-kube-api-access-k265n\") pod \"node-resolver-5bgxb\" (UID: \"74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365\") " pod="openshift-dns/node-resolver-5bgxb" Jul 22 02:16:40.571306 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569306 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88ba46ca-7b85-49ff-a952-f5e94af52408-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.571306 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569316 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-dbus\") pod \"global-pull-secret-syncer-rxh5h\" (UID: \"7f8aa8dc-6c8f-4e21-84be-429e861b5fa0\") " pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:40.571869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569334 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9099cc96-5e4a-490d-8118-171b1eba8b6d-iptables-alerter-script\") pod \"iptables-alerter-bmwlm\" (UID: \"9099cc96-5e4a-490d-8118-171b1eba8b6d\") " pod="openshift-network-operator/iptables-alerter-bmwlm" Jul 22 02:16:40.571869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569357 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-log-socket\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.571869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569370 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/241b6cf2-254d-4233-8d0a-0b373bd1236d-agent-certs\") pod \"konnectivity-agent-pqx7f\" (UID: \"241b6cf2-254d-4233-8d0a-0b373bd1236d\") " pod="kube-system/konnectivity-agent-pqx7f" Jul 22 02:16:40.571869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569430 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-slash\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.571869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569462 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-run-ovn-kubernetes\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.571869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569492 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88ba46ca-7b85-49ff-a952-f5e94af52408-cni-binary-copy\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.571869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569519 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6afb404db9de437e9c415b35d8e765f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal\" (UID: \"f6afb404db9de437e9c415b35d8e765f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal" Jul 22 02:16:40.571869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569549 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-sysctl-conf\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.571869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569559 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-run-ovn-kubernetes\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.571869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569574 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-sys\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.571869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569599 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9099cc96-5e4a-490d-8118-171b1eba8b6d-host-slash\") pod \"iptables-alerter-bmwlm\" (UID: \"9099cc96-5e4a-490d-8118-171b1eba8b6d\") " pod="openshift-network-operator/iptables-alerter-bmwlm" Jul 22 02:16:40.571869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569616 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e145c77-ffbb-4a29-8b35-d7c949a16215-host-slash\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.571869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569625 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-kubelet-config\") pod \"global-pull-secret-syncer-rxh5h\" (UID: \"7f8aa8dc-6c8f-4e21-84be-429e861b5fa0\") " pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:40.571869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569661 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-os-release\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.571869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569709 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-host-var-lib-cni-multus\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.571869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569752 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-sys\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.571869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569768 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-sysctl-conf\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.572547 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569793 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-host-var-lib-cni-multus\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.572547 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569822 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6afb404db9de437e9c415b35d8e765f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal\" (UID: \"f6afb404db9de437e9c415b35d8e765f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal" Jul 22 02:16:40.572547 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569837 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-os-release\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.572547 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569857 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9099cc96-5e4a-490d-8118-171b1eba8b6d-host-slash\") pod \"iptables-alerter-bmwlm\" (UID: \"9099cc96-5e4a-490d-8118-171b1eba8b6d\") " pod="openshift-network-operator/iptables-alerter-bmwlm" Jul 22 02:16:40.572547 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569858 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-kubelet-config\") pod \"global-pull-secret-syncer-rxh5h\" (UID: \"7f8aa8dc-6c8f-4e21-84be-429e861b5fa0\") " pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:40.572547 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.569902 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9099cc96-5e4a-490d-8118-171b1eba8b6d-iptables-alerter-script\") pod \"iptables-alerter-bmwlm\" (UID: \"9099cc96-5e4a-490d-8118-171b1eba8b6d\") " pod="openshift-network-operator/iptables-alerter-bmwlm" Jul 22 02:16:40.572547 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.572215 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-tmp\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.572547 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.572416 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-etc-tuned\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.572547 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.572532 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e145c77-ffbb-4a29-8b35-d7c949a16215-ovn-node-metrics-cert\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.572868 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.572697 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/241b6cf2-254d-4233-8d0a-0b373bd1236d-agent-certs\") pod \"konnectivity-agent-pqx7f\" (UID: \"241b6cf2-254d-4233-8d0a-0b373bd1236d\") " pod="kube-system/konnectivity-agent-pqx7f" Jul 22 02:16:40.576266 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.576241 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hcff\" (UniqueName: \"kubernetes.io/projected/19b441a9-443f-4cac-8a30-d9fd5e4a4cca-kube-api-access-5hcff\") pod \"node-ca-9r7nk\" (UID: \"19b441a9-443f-4cac-8a30-d9fd5e4a4cca\") " pod="openshift-image-registry/node-ca-9r7nk" Jul 22 02:16:40.576393 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.576276 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hctg4\" (UniqueName: \"kubernetes.io/projected/6ee4b230-9857-4cb9-a2d3-9c1ea34ff730-kube-api-access-hctg4\") pod \"multus-2wwsz\" (UID: \"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730\") " pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.577201 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.577114 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njpjx\" (UniqueName: \"kubernetes.io/projected/9099cc96-5e4a-490d-8118-171b1eba8b6d-kube-api-access-njpjx\") pod \"iptables-alerter-bmwlm\" (UID: \"9099cc96-5e4a-490d-8118-171b1eba8b6d\") " pod="openshift-network-operator/iptables-alerter-bmwlm" Jul 22 02:16:40.578145 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.578121 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kccv\" (UniqueName: \"kubernetes.io/projected/f25eed9e-6c88-419b-a963-9097079cf48c-kube-api-access-2kccv\") pod \"aws-ebs-csi-driver-node-dwx8w\" (UID: \"f25eed9e-6c88-419b-a963-9097079cf48c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.578486 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.578462 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k265n\" (UniqueName: \"kubernetes.io/projected/74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365-kube-api-access-k265n\") pod \"node-resolver-5bgxb\" (UID: \"74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365\") " pod="openshift-dns/node-resolver-5bgxb" Jul 22 02:16:40.579088 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.579070 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snslt\" (UniqueName: \"kubernetes.io/projected/2d29d38a-b0b7-4a48-aab7-cfc67bb67b35-kube-api-access-snslt\") pod \"tuned-c9w8w\" (UID: \"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35\") " pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.579277 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.579259 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fkrw\" (UniqueName: \"kubernetes.io/projected/1e145c77-ffbb-4a29-8b35-d7c949a16215-kube-api-access-9fkrw\") pod \"ovnkube-node-zn9wn\" (UID: \"1e145c77-ffbb-4a29-8b35-d7c949a16215\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.591661 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.591632 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2wwsz" Jul 22 02:16:40.670702 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.670670 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88ba46ca-7b85-49ff-a952-f5e94af52408-cnibin\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.670904 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.670740 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88ba46ca-7b85-49ff-a952-f5e94af52408-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.670904 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.670771 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq2d5\" (UniqueName: \"kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5\") pod \"network-check-target-548xn\" (UID: \"78545e6e-eee9-4191-a1d3-66ef62a849c6\") " pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:16:40.670904 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.670798 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88ba46ca-7b85-49ff-a952-f5e94af52408-system-cni-dir\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.670904 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.670817 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88ba46ca-7b85-49ff-a952-f5e94af52408-cnibin\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.670904 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.670868 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88ba46ca-7b85-49ff-a952-f5e94af52408-system-cni-dir\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.670904 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.670823 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88ba46ca-7b85-49ff-a952-f5e94af52408-os-release\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.671245 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.670906 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88ba46ca-7b85-49ff-a952-f5e94af52408-os-release\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.671245 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.670916 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88ba46ca-7b85-49ff-a952-f5e94af52408-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.671245 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.670946 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs\") pod \"network-metrics-daemon-hmqt5\" (UID: \"c581daf0-338d-43d1-923f-6283ebe6405a\") " pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:16:40.671245 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.670995 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88ba46ca-7b85-49ff-a952-f5e94af52408-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.671245 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.671026 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88ba46ca-7b85-49ff-a952-f5e94af52408-cni-binary-copy\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.671245 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.671080 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfs2d\" (UniqueName: \"kubernetes.io/projected/c581daf0-338d-43d1-923f-6283ebe6405a-kube-api-access-zfs2d\") pod \"network-metrics-daemon-hmqt5\" (UID: \"c581daf0-338d-43d1-923f-6283ebe6405a\") " pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:16:40.671245 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:40.671091 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:40.671245 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.671134 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88ba46ca-7b85-49ff-a952-f5e94af52408-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.671245 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.671134 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km5xs\" (UniqueName: \"kubernetes.io/projected/88ba46ca-7b85-49ff-a952-f5e94af52408-kube-api-access-km5xs\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.671245 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:40.671156 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs podName:c581daf0-338d-43d1-923f-6283ebe6405a nodeName:}" failed. No retries permitted until 2026-07-22 02:16:41.171133796 +0000 UTC m=+2.279553139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs") pod "network-metrics-daemon-hmqt5" (UID: "c581daf0-338d-43d1-923f-6283ebe6405a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:40.671648 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.671560 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88ba46ca-7b85-49ff-a952-f5e94af52408-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.671744 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.671727 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88ba46ca-7b85-49ff-a952-f5e94af52408-cni-binary-copy\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.671791 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.671752 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88ba46ca-7b85-49ff-a952-f5e94af52408-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.672465 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.672446 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j7kpp" Jul 22 02:16:40.682204 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.682148 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j7kpp" Jul 22 02:16:40.684021 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:40.684001 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:16:40.684021 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:40.684022 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:16:40.684162 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:40.684033 2556 projected.go:196] Error preparing data for projected volume kube-api-access-pq2d5 for pod openshift-network-diagnostics/network-check-target-548xn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:40.684162 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:40.684098 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5 podName:78545e6e-eee9-4191-a1d3-66ef62a849c6 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:41.184079761 +0000 UTC m=+2.292499078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pq2d5" (UniqueName: "kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5") pod "network-check-target-548xn" (UID: "78545e6e-eee9-4191-a1d3-66ef62a849c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:40.686436 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.686413 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km5xs\" (UniqueName: \"kubernetes.io/projected/88ba46ca-7b85-49ff-a952-f5e94af52408-kube-api-access-km5xs\") pod \"multus-additional-cni-plugins-cnvr9\" (UID: \"88ba46ca-7b85-49ff-a952-f5e94af52408\") " pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:40.686513 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.686486 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfs2d\" (UniqueName: \"kubernetes.io/projected/c581daf0-338d-43d1-923f-6283ebe6405a-kube-api-access-zfs2d\") pod \"network-metrics-daemon-hmqt5\" (UID: \"c581daf0-338d-43d1-923f-6283ebe6405a\") " pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:16:40.690004 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.689987 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-41.ec2.internal" Jul 22 02:16:40.696190 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.696172 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal" Jul 22 02:16:40.776185 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.776152 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" Jul 22 02:16:40.794683 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.794639 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9r7nk" Jul 22 02:16:40.801513 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.801496 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bmwlm" Jul 22 02:16:40.824835 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.824801 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:16:40.842850 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.842823 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pqx7f" Jul 22 02:16:40.854442 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.854416 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" Jul 22 02:16:40.861254 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.861235 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5bgxb" Jul 22 02:16:40.897766 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:40.897711 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cnvr9" Jul 22 02:16:41.076999 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:41.076927 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret\") pod \"global-pull-secret-syncer-rxh5h\" (UID: \"7f8aa8dc-6c8f-4e21-84be-429e861b5fa0\") " pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:41.077233 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:41.077133 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:41.077233 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:41.077223 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret podName:7f8aa8dc-6c8f-4e21-84be-429e861b5fa0 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:42.077201255 +0000 UTC m=+3.185620582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret") pod "global-pull-secret-syncer-rxh5h" (UID: "7f8aa8dc-6c8f-4e21-84be-429e861b5fa0") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:41.167984 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:41.167899 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee4b230_9857_4cb9_a2d3_9c1ea34ff730.slice/crio-8eba144c74ed2798fabbef36b9e755e55eb74074a9b08c15433086f071a5ed04 WatchSource:0}: Error finding container 8eba144c74ed2798fabbef36b9e755e55eb74074a9b08c15433086f071a5ed04: Status 404 returned error can't find the container with id 8eba144c74ed2798fabbef36b9e755e55eb74074a9b08c15433086f071a5ed04 Jul 22 02:16:41.170670 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:41.170638 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a2b0b0078cc79ecb5329ccfa51d0dad.slice/crio-3afbfd059cb1e6ad9af581d5b556756ffffa1d678218fceae9630d2bca07f5ce WatchSource:0}: Error finding container 3afbfd059cb1e6ad9af581d5b556756ffffa1d678218fceae9630d2bca07f5ce: Status 404 returned error can't find the container with id 3afbfd059cb1e6ad9af581d5b556756ffffa1d678218fceae9630d2bca07f5ce Jul 22 02:16:41.171228 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:41.171202 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d29d38a_b0b7_4a48_aab7_cfc67bb67b35.slice/crio-52f7db44d507d08929251f023150e9ae978bb51713cd88e218e781868d78d404 WatchSource:0}: Error finding container 52f7db44d507d08929251f023150e9ae978bb51713cd88e218e781868d78d404: Status 404 returned error can't find the container with id 52f7db44d507d08929251f023150e9ae978bb51713cd88e218e781868d78d404 Jul 22 02:16:41.174982 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:41.174963 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 02:16:41.178031 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:41.178004 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs\") pod \"network-metrics-daemon-hmqt5\" (UID: \"c581daf0-338d-43d1-923f-6283ebe6405a\") " pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:16:41.178172 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:41.178153 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:41.178239 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:41.178220 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs podName:c581daf0-338d-43d1-923f-6283ebe6405a nodeName:}" failed. No retries permitted until 2026-07-22 02:16:42.178205293 +0000 UTC m=+3.286624609 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs") pod "network-metrics-daemon-hmqt5" (UID: "c581daf0-338d-43d1-923f-6283ebe6405a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:41.192908 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:41.192884 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b441a9_443f_4cac_8a30_d9fd5e4a4cca.slice/crio-07fcb489c6f2be6cf9eeea4cf614a5ab0d81417e290bd35b716bff599967fa3d WatchSource:0}: Error finding container 07fcb489c6f2be6cf9eeea4cf614a5ab0d81417e290bd35b716bff599967fa3d: Status 404 returned error can't find the container with id 07fcb489c6f2be6cf9eeea4cf614a5ab0d81417e290bd35b716bff599967fa3d Jul 22 02:16:41.207958 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:41.207934 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ba46ca_7b85_49ff_a952_f5e94af52408.slice/crio-06a8992d2420e99456a13c01341c88a0f82996ae1745aa2311e75e5f9fa762e1 WatchSource:0}: Error finding container 06a8992d2420e99456a13c01341c88a0f82996ae1745aa2311e75e5f9fa762e1: Status 404 returned error can't find the container with id 06a8992d2420e99456a13c01341c88a0f82996ae1745aa2311e75e5f9fa762e1 Jul 22 02:16:41.209322 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:41.209281 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74e8d4ad_5d63_4e10_b2fd_1f09c1bd2365.slice/crio-78f472d003d68be70fe4d9164ab46e6288439de8fbc278f09dfdd3ae7958cf66 WatchSource:0}: Error finding container 78f472d003d68be70fe4d9164ab46e6288439de8fbc278f09dfdd3ae7958cf66: Status 404 returned error can't find the container with id 78f472d003d68be70fe4d9164ab46e6288439de8fbc278f09dfdd3ae7958cf66 Jul 22 02:16:41.251598 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:41.251557 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6afb404db9de437e9c415b35d8e765f.slice/crio-e4b418ce8c03b1678cb6c4af35e2079ffe3ca9dbda9cd540f72c042470c0eba2 WatchSource:0}: Error finding container e4b418ce8c03b1678cb6c4af35e2079ffe3ca9dbda9cd540f72c042470c0eba2: Status 404 returned error can't find the container with id e4b418ce8c03b1678cb6c4af35e2079ffe3ca9dbda9cd540f72c042470c0eba2 Jul 22 02:16:41.251751 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:41.251701 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2wwsz" event={"ID":"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730","Type":"ContainerStarted","Data":"8eba144c74ed2798fabbef36b9e755e55eb74074a9b08c15433086f071a5ed04"} Jul 22 02:16:41.252860 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:41.252834 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5bgxb" event={"ID":"74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365","Type":"ContainerStarted","Data":"78f472d003d68be70fe4d9164ab46e6288439de8fbc278f09dfdd3ae7958cf66"} Jul 22 02:16:41.253954 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:41.253931 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnvr9" event={"ID":"88ba46ca-7b85-49ff-a952-f5e94af52408","Type":"ContainerStarted","Data":"06a8992d2420e99456a13c01341c88a0f82996ae1745aa2311e75e5f9fa762e1"} Jul 22 02:16:41.255038 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:41.255009 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9r7nk" event={"ID":"19b441a9-443f-4cac-8a30-d9fd5e4a4cca","Type":"ContainerStarted","Data":"07fcb489c6f2be6cf9eeea4cf614a5ab0d81417e290bd35b716bff599967fa3d"} Jul 22 02:16:41.256292 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:41.256267 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" event={"ID":"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35","Type":"ContainerStarted","Data":"52f7db44d507d08929251f023150e9ae978bb51713cd88e218e781868d78d404"} Jul 22 02:16:41.257352 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:41.257332 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-41.ec2.internal" event={"ID":"0a2b0b0078cc79ecb5329ccfa51d0dad","Type":"ContainerStarted","Data":"3afbfd059cb1e6ad9af581d5b556756ffffa1d678218fceae9630d2bca07f5ce"} Jul 22 02:16:41.275167 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:41.275143 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9099cc96_5e4a_490d_8118_171b1eba8b6d.slice/crio-b70a4c5cd87c182c51a70560b997ec3cb16298a1df6209d2b272acc483d197e2 WatchSource:0}: Error finding container b70a4c5cd87c182c51a70560b997ec3cb16298a1df6209d2b272acc483d197e2: Status 404 returned error can't find the container with id b70a4c5cd87c182c51a70560b997ec3cb16298a1df6209d2b272acc483d197e2 Jul 22 02:16:41.278468 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:41.278447 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq2d5\" (UniqueName: \"kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5\") pod \"network-check-target-548xn\" (UID: \"78545e6e-eee9-4191-a1d3-66ef62a849c6\") " pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:16:41.278584 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:41.278572 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:16:41.278632 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:41.278587 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:16:41.278632 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:41.278597 2556 projected.go:196] Error preparing data for projected volume kube-api-access-pq2d5 for pod openshift-network-diagnostics/network-check-target-548xn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:41.278725 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:41.278658 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5 podName:78545e6e-eee9-4191-a1d3-66ef62a849c6 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:42.278645084 +0000 UTC m=+3.387064414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pq2d5" (UniqueName: "kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5") pod "network-check-target-548xn" (UID: "78545e6e-eee9-4191-a1d3-66ef62a849c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:41.312518 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:41.312490 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 02:16:41.314394 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:41.314367 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf25eed9e_6c88_419b_a963_9097079cf48c.slice/crio-17af1a81400bc0ae77caae3e0fbb514e1459b35f09e225e40977d88784f254c9 WatchSource:0}: Error finding container 17af1a81400bc0ae77caae3e0fbb514e1459b35f09e225e40977d88784f254c9: Status 404 returned error can't find the container with id 17af1a81400bc0ae77caae3e0fbb514e1459b35f09e225e40977d88784f254c9 Jul 22 02:16:41.396330 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:16:41.396303 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e145c77_ffbb_4a29_8b35_d7c949a16215.slice/crio-24709a790a6643e7bdabc16c2e78a214300c02dc383823d8172c3ea7d00c7eca WatchSource:0}: Error finding container 24709a790a6643e7bdabc16c2e78a214300c02dc383823d8172c3ea7d00c7eca: Status 404 returned error can't find the container with id 24709a790a6643e7bdabc16c2e78a214300c02dc383823d8172c3ea7d00c7eca Jul 22 02:16:41.685254 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:41.685144 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 02:11:40 +0000 UTC" deadline="2028-02-29 11:32:22.33823505 +0000 UTC" Jul 22 02:16:41.685254 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:41.685190 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14097h15m40.653049999s" Jul 22 02:16:41.795582 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:41.795549 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 02:16:41.909986 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:41.909953 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 02:16:42.085357 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:42.085272 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret\") pod \"global-pull-secret-syncer-rxh5h\" (UID: \"7f8aa8dc-6c8f-4e21-84be-429e861b5fa0\") " pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:42.085525 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:42.085469 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:42.085594 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:42.085547 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret podName:7f8aa8dc-6c8f-4e21-84be-429e861b5fa0 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:44.085525242 +0000 UTC m=+5.193944573 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret") pod "global-pull-secret-syncer-rxh5h" (UID: "7f8aa8dc-6c8f-4e21-84be-429e861b5fa0") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:42.186715 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:42.186644 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs\") pod \"network-metrics-daemon-hmqt5\" (UID: \"c581daf0-338d-43d1-923f-6283ebe6405a\") " pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:16:42.186941 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:42.186919 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:42.187036 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:42.187024 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs podName:c581daf0-338d-43d1-923f-6283ebe6405a nodeName:}" failed. No retries permitted until 2026-07-22 02:16:44.187003779 +0000 UTC m=+5.295423110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs") pod "network-metrics-daemon-hmqt5" (UID: "c581daf0-338d-43d1-923f-6283ebe6405a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:42.251195 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:42.251163 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:42.251404 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:42.251304 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:16:42.251800 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:42.251740 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:16:42.251900 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:42.251849 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:16:42.251965 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:42.251920 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:16:42.252026 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:42.251987 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:16:42.287861 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:42.287824 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq2d5\" (UniqueName: \"kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5\") pod \"network-check-target-548xn\" (UID: \"78545e6e-eee9-4191-a1d3-66ef62a849c6\") " pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:16:42.288065 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:42.288046 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:16:42.288131 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:42.288076 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:16:42.288131 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:42.288090 2556 projected.go:196] Error preparing data for projected volume kube-api-access-pq2d5 for pod openshift-network-diagnostics/network-check-target-548xn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:42.288245 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:42.288147 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5 podName:78545e6e-eee9-4191-a1d3-66ef62a849c6 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:44.288128348 +0000 UTC m=+5.396547679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pq2d5" (UniqueName: "kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5") pod "network-check-target-548xn" (UID: "78545e6e-eee9-4191-a1d3-66ef62a849c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:42.302678 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:42.302638 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" event={"ID":"1e145c77-ffbb-4a29-8b35-d7c949a16215","Type":"ContainerStarted","Data":"24709a790a6643e7bdabc16c2e78a214300c02dc383823d8172c3ea7d00c7eca"} Jul 22 02:16:42.320729 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:42.320513 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pqx7f" event={"ID":"241b6cf2-254d-4233-8d0a-0b373bd1236d","Type":"ContainerStarted","Data":"a42d56e40a969cc1ad2b6229087b33e07458db38c886589bb148b92a071f605b"} Jul 22 02:16:42.347823 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:42.347730 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" event={"ID":"f25eed9e-6c88-419b-a963-9097079cf48c","Type":"ContainerStarted","Data":"17af1a81400bc0ae77caae3e0fbb514e1459b35f09e225e40977d88784f254c9"} Jul 22 02:16:42.380225 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:42.380184 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bmwlm" event={"ID":"9099cc96-5e4a-490d-8118-171b1eba8b6d","Type":"ContainerStarted","Data":"b70a4c5cd87c182c51a70560b997ec3cb16298a1df6209d2b272acc483d197e2"} Jul 22 02:16:42.402376 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:42.402336 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal" event={"ID":"f6afb404db9de437e9c415b35d8e765f","Type":"ContainerStarted","Data":"e4b418ce8c03b1678cb6c4af35e2079ffe3ca9dbda9cd540f72c042470c0eba2"} Jul 22 02:16:42.686427 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:42.686337 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 02:11:40 +0000 UTC" deadline="2028-03-26 17:01:05.93855845 +0000 UTC" Jul 22 02:16:42.686427 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:42.686381 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14726h44m23.252182673s" Jul 22 02:16:44.108687 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:44.108649 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret\") pod \"global-pull-secret-syncer-rxh5h\" (UID: \"7f8aa8dc-6c8f-4e21-84be-429e861b5fa0\") " pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:44.109167 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:44.108861 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:44.109167 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:44.108933 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret podName:7f8aa8dc-6c8f-4e21-84be-429e861b5fa0 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:48.108911071 +0000 UTC m=+9.217330401 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret") pod "global-pull-secret-syncer-rxh5h" (UID: "7f8aa8dc-6c8f-4e21-84be-429e861b5fa0") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:44.213422 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:44.212552 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs\") pod \"network-metrics-daemon-hmqt5\" (UID: \"c581daf0-338d-43d1-923f-6283ebe6405a\") " pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:16:44.213422 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:44.212716 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:44.213422 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:44.212798 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs podName:c581daf0-338d-43d1-923f-6283ebe6405a nodeName:}" failed. No retries permitted until 2026-07-22 02:16:48.212778642 +0000 UTC m=+9.321197970 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs") pod "network-metrics-daemon-hmqt5" (UID: "c581daf0-338d-43d1-923f-6283ebe6405a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:44.250969 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:44.250938 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:44.251161 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:44.251081 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:16:44.251161 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:44.251159 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:16:44.251277 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:44.251245 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:16:44.251332 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:44.251286 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:16:44.251383 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:44.251347 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:16:44.313440 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:44.313394 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq2d5\" (UniqueName: \"kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5\") pod \"network-check-target-548xn\" (UID: \"78545e6e-eee9-4191-a1d3-66ef62a849c6\") " pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:16:44.313609 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:44.313572 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:16:44.313609 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:44.313596 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:16:44.313745 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:44.313611 2556 projected.go:196] Error preparing data for projected volume kube-api-access-pq2d5 for pod openshift-network-diagnostics/network-check-target-548xn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:44.313745 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:44.313685 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5 podName:78545e6e-eee9-4191-a1d3-66ef62a849c6 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:48.313664565 +0000 UTC m=+9.422083895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pq2d5" (UniqueName: "kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5") pod "network-check-target-548xn" (UID: "78545e6e-eee9-4191-a1d3-66ef62a849c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:46.249660 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:46.249517 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:46.250675 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:46.250418 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:16:46.250886 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:46.250845 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:16:46.250974 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:46.250953 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:16:46.251029 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:46.251017 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:16:46.251097 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:46.251082 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:16:48.150359 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:48.150322 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret\") pod \"global-pull-secret-syncer-rxh5h\" (UID: \"7f8aa8dc-6c8f-4e21-84be-429e861b5fa0\") " pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:48.150862 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:48.150463 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:48.150862 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:48.150546 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret podName:7f8aa8dc-6c8f-4e21-84be-429e861b5fa0 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:56.150525146 +0000 UTC m=+17.258944475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret") pod "global-pull-secret-syncer-rxh5h" (UID: "7f8aa8dc-6c8f-4e21-84be-429e861b5fa0") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:48.249205 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:48.248962 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:48.249205 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:48.248962 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:16:48.249447 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:48.249218 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:16:48.249447 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:48.249105 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:16:48.249447 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:48.249258 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:16:48.249447 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:48.249336 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:16:48.251372 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:48.251081 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs\") pod \"network-metrics-daemon-hmqt5\" (UID: \"c581daf0-338d-43d1-923f-6283ebe6405a\") " pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:16:48.251372 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:48.251244 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:48.251372 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:48.251300 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs podName:c581daf0-338d-43d1-923f-6283ebe6405a nodeName:}" failed. No retries permitted until 2026-07-22 02:16:56.251280126 +0000 UTC m=+17.359699466 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs") pod "network-metrics-daemon-hmqt5" (UID: "c581daf0-338d-43d1-923f-6283ebe6405a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:48.352540 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:48.351861 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq2d5\" (UniqueName: \"kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5\") pod \"network-check-target-548xn\" (UID: \"78545e6e-eee9-4191-a1d3-66ef62a849c6\") " pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:16:48.352540 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:48.352108 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:16:48.352540 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:48.352128 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:16:48.352540 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:48.352140 2556 projected.go:196] Error preparing data for projected volume kube-api-access-pq2d5 for pod openshift-network-diagnostics/network-check-target-548xn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:48.352540 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:48.352198 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5 podName:78545e6e-eee9-4191-a1d3-66ef62a849c6 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:56.352180419 +0000 UTC m=+17.460599746 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pq2d5" (UniqueName: "kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5") pod "network-check-target-548xn" (UID: "78545e6e-eee9-4191-a1d3-66ef62a849c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:50.250960 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:50.250169 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:50.250960 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:50.250284 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:16:50.250960 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:50.250700 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:16:50.250960 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:50.250803 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:16:50.250960 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:50.250862 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:16:50.250960 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:50.250926 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:16:52.248749 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:52.248706 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:16:52.249227 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:52.248706 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:52.249227 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:52.248836 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:16:52.249227 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:52.248706 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:16:52.249227 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:52.248933 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:16:52.249227 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:52.249038 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:16:54.249081 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:54.249040 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:54.249081 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:54.249086 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:16:54.249570 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:54.249038 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:16:54.249570 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:54.249186 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:16:54.249570 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:54.249369 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:16:54.249570 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:54.249473 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:16:56.215458 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:56.215413 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret\") pod \"global-pull-secret-syncer-rxh5h\" (UID: \"7f8aa8dc-6c8f-4e21-84be-429e861b5fa0\") " pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:56.215930 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:56.215570 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:56.215930 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:56.215673 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret podName:7f8aa8dc-6c8f-4e21-84be-429e861b5fa0 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:12.215635006 +0000 UTC m=+33.324054323 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret") pod "global-pull-secret-syncer-rxh5h" (UID: "7f8aa8dc-6c8f-4e21-84be-429e861b5fa0") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:56.249057 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:56.249020 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:16:56.249230 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:56.249023 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:56.249230 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:56.249166 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:16:56.249230 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:56.249033 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:16:56.249376 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:56.249226 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:16:56.249376 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:56.249300 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:16:56.316694 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:56.316651 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs\") pod \"network-metrics-daemon-hmqt5\" (UID: \"c581daf0-338d-43d1-923f-6283ebe6405a\") " pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:16:56.316869 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:56.316778 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:56.316933 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:56.316871 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs podName:c581daf0-338d-43d1-923f-6283ebe6405a nodeName:}" failed. No retries permitted until 2026-07-22 02:17:12.316849414 +0000 UTC m=+33.425268746 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs") pod "network-metrics-daemon-hmqt5" (UID: "c581daf0-338d-43d1-923f-6283ebe6405a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:56.417684 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:56.417628 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq2d5\" (UniqueName: \"kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5\") pod \"network-check-target-548xn\" (UID: \"78545e6e-eee9-4191-a1d3-66ef62a849c6\") " pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:16:56.417865 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:56.417824 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:16:56.417865 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:56.417853 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:16:56.417865 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:56.417866 2556 projected.go:196] Error preparing data for projected volume kube-api-access-pq2d5 for pod openshift-network-diagnostics/network-check-target-548xn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:56.418029 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:56.417932 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5 podName:78545e6e-eee9-4191-a1d3-66ef62a849c6 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:12.417913393 +0000 UTC m=+33.526332723 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pq2d5" (UniqueName: "kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5") pod "network-check-target-548xn" (UID: "78545e6e-eee9-4191-a1d3-66ef62a849c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:58.249176 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:58.249137 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:16:58.249663 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:58.249137 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:16:58.249663 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:58.249259 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:16:58.249663 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:16:58.249295 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:16:58.249663 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:58.249400 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:16:58.249663 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:16:58.249488 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:17:00.249866 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:00.249829 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:00.250332 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:00.249960 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:00.250332 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:00.249957 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:17:00.250332 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:00.250049 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:17:00.250332 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:00.250054 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:00.250332 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:00.250131 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:17:02.249200 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.248897 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:02.249863 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.248897 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:02.249863 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:02.249295 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:17:02.249863 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:02.249344 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:17:02.249863 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.248897 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:02.249863 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:02.249408 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:17:02.449953 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.449927 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" event={"ID":"2d29d38a-b0b7-4a48-aab7-cfc67bb67b35","Type":"ContainerStarted","Data":"c48299dd638e815ccc4843844ae714f83f2af851dda0c56bfd3dc66978329116"} Jul 22 02:17:02.451376 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.451351 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2wwsz" event={"ID":"6ee4b230-9857-4cb9-a2d3-9c1ea34ff730","Type":"ContainerStarted","Data":"93c659aa19cd85fa8d7fcad94b80a84bb7a24f395a710910a4e58f68aae123a0"} Jul 22 02:17:02.452667 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.452625 2556 generic.go:356] "Generic (PLEG): container finished" podID="f6afb404db9de437e9c415b35d8e765f" containerID="984d231744b5ec443df76d65d3dc115f76bfc873ac088916210060ea2318c67a" exitCode=0 Jul 22 02:17:02.452746 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.452669 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal" event={"ID":"f6afb404db9de437e9c415b35d8e765f","Type":"ContainerDied","Data":"984d231744b5ec443df76d65d3dc115f76bfc873ac088916210060ea2318c67a"} Jul 22 02:17:02.454072 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.454051 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5bgxb" event={"ID":"74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365","Type":"ContainerStarted","Data":"5b6bf566cd07233ef460e71d85d896666790e0d891bc206b16690c7a8d3917c7"} Jul 22 02:17:02.455469 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.455444 2556 generic.go:356] "Generic (PLEG): container finished" podID="88ba46ca-7b85-49ff-a952-f5e94af52408" containerID="6c4cd9d5a3759204e96b816af6192078e75483c8b4347c875c914d910fbeacb8" exitCode=0 Jul 22 02:17:02.455532 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.455511 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnvr9" event={"ID":"88ba46ca-7b85-49ff-a952-f5e94af52408","Type":"ContainerDied","Data":"6c4cd9d5a3759204e96b816af6192078e75483c8b4347c875c914d910fbeacb8"} Jul 22 02:17:02.456846 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.456820 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9r7nk" event={"ID":"19b441a9-443f-4cac-8a30-d9fd5e4a4cca","Type":"ContainerStarted","Data":"b2709aeac19386267518801b58433e4c4a5c5fb03063fed7428ecf93130fd1c4"} Jul 22 02:17:02.458446 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.458426 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-41.ec2.internal" event={"ID":"0a2b0b0078cc79ecb5329ccfa51d0dad","Type":"ContainerStarted","Data":"ae236c7d273ba8ae8932f25e5d1dd670469fdc68e22fe41fcacab79ceafe6241"} Jul 22 02:17:02.461065 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.461041 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" event={"ID":"1e145c77-ffbb-4a29-8b35-d7c949a16215","Type":"ContainerStarted","Data":"3f5b2501dfe587e100e8938979f854e16e2987a38ed8e4cad140c907dabe868b"} Jul 22 02:17:02.461159 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.461122 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" event={"ID":"1e145c77-ffbb-4a29-8b35-d7c949a16215","Type":"ContainerStarted","Data":"ddffcb6bb32006a61105943db7fab44d20228c0daf53611f5908843da4d87386"} Jul 22 02:17:02.461222 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.461174 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" event={"ID":"1e145c77-ffbb-4a29-8b35-d7c949a16215","Type":"ContainerStarted","Data":"c1a9342d5063e514e77c81c5e207e00dacada4f0ac07acb198283665cdf64ea8"} Jul 22 02:17:02.461281 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.461244 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" event={"ID":"1e145c77-ffbb-4a29-8b35-d7c949a16215","Type":"ContainerStarted","Data":"b77795259c2b7e0acd282f2bcdd55186b8dbf3a7e656a44ff65013d93caf226a"} Jul 22 02:17:02.461331 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.461295 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" event={"ID":"1e145c77-ffbb-4a29-8b35-d7c949a16215","Type":"ContainerStarted","Data":"e57012710ae65b3c9460c583f33f6305fc6c2be60fa14280a83f7a650e025274"} Jul 22 02:17:02.463107 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.463088 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pqx7f" event={"ID":"241b6cf2-254d-4233-8d0a-0b373bd1236d","Type":"ContainerStarted","Data":"2e4fe713fbae90847fa7ab9b80b622ddf21975fe8e5f575f46ba1f8527d510b6"} Jul 22 02:17:02.464584 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.464564 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" event={"ID":"f25eed9e-6c88-419b-a963-9097079cf48c","Type":"ContainerStarted","Data":"462f28e9efee58a5b2df3fece14ae57077dbbcc7660c0c03eddc5f83e3930401"} Jul 22 02:17:02.471395 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.469349 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c9w8w" podStartSLOduration=2.298580069 podStartE2EDuration="22.469333541s" totalImagesPullingTime="20.170753472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:02.468895039 +0000 UTC m=+23.577314377" watchObservedRunningTime="2026-07-22 02:17:02.469333541 +0000 UTC m=+23.577752878" Jul 22 02:17:02.482798 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.482759 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-41.ec2.internal" podStartSLOduration=22.482747041 podStartE2EDuration="22.482747041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:02.482666791 +0000 UTC m=+23.591086137" watchObservedRunningTime="2026-07-22 02:17:02.482747041 +0000 UTC m=+23.591166376" Jul 22 02:17:02.501669 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.501608 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9r7nk" podStartSLOduration=2.376043762 podStartE2EDuration="22.501592991s" totalImagesPullingTime="20.125549229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:02.501235431 +0000 UTC m=+23.609654768" watchObservedRunningTime="2026-07-22 02:17:02.501592991 +0000 UTC m=+23.610012328" Jul 22 02:17:02.538803 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.538750 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pqx7f" podStartSLOduration=2.532006139 podStartE2EDuration="22.538733093s" totalImagesPullingTime="20.006726954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:02.538366507 +0000 UTC m=+23.646785843" watchObservedRunningTime="2026-07-22 02:17:02.538733093 +0000 UTC m=+23.647152428" Jul 22 02:17:02.554204 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.554156 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5bgxb" podStartSLOduration=2.420906261 podStartE2EDuration="22.554140137s" totalImagesPullingTime="20.133233876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:02.553550861 +0000 UTC m=+23.661970197" watchObservedRunningTime="2026-07-22 02:17:02.554140137 +0000 UTC m=+23.662559472" Jul 22 02:17:02.570887 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.570707 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2wwsz" podStartSLOduration=2.3666441320000002 podStartE2EDuration="22.570691859s" totalImagesPullingTime="20.204047727s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:02.570277882 +0000 UTC m=+23.678697219" watchObservedRunningTime="2026-07-22 02:17:02.570691859 +0000 UTC m=+23.679111195" Jul 22 02:17:02.714435 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.714340 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqx7f_241b6cf2-254d-4233-8d0a-0b373bd1236d/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:02.777755 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:02.777709 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqx7f_241b6cf2-254d-4233-8d0a-0b373bd1236d/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:03.389592 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:03.389566 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 22 02:17:03.470446 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:03.470406 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" event={"ID":"1e145c77-ffbb-4a29-8b35-d7c949a16215","Type":"ContainerStarted","Data":"1daedf6cb72329f05675e79b7ae2dcdecd1b377d9d6b0bb12c66b39863b3d879"} Jul 22 02:17:03.472433 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:03.472403 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" event={"ID":"f25eed9e-6c88-419b-a963-9097079cf48c","Type":"ContainerStarted","Data":"37717e8110f8fe8dfe6fabe8c6175496b25b139c44611b577511ed7bc6397402"} Jul 22 02:17:03.474175 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:03.474148 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bmwlm" event={"ID":"9099cc96-5e4a-490d-8118-171b1eba8b6d","Type":"ContainerStarted","Data":"1cb24004d72ef00e84696cda26530336ad9fb47bba83b10bd2bb52ffdb5ccfe5"} Jul 22 02:17:03.625362 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:03.625327 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqx7f_241b6cf2-254d-4233-8d0a-0b373bd1236d/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:03.687890 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:03.687854 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqx7f_241b6cf2-254d-4233-8d0a-0b373bd1236d/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:03.708341 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:03.708214 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T02:17:03.389586185Z","UUID":"2a64f96d-a20a-449a-b3d2-81e33b868852","Handler":null,"Name":"","Endpoint":""} Jul 22 02:17:03.709765 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:03.709739 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 22 02:17:03.709887 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:03.709780 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 22 02:17:04.249300 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:04.249271 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:04.249597 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:04.249397 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:17:04.249875 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:04.249853 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:04.249986 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:04.249961 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:17:04.250135 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:04.250108 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:04.250228 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:04.250189 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:17:04.479397 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:04.479330 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal" event={"ID":"f6afb404db9de437e9c415b35d8e765f","Type":"ContainerStarted","Data":"adf6625ef1d203bd51e7453883ad30bdb29f8f159a24cb5cacefcf60e2cb53f0"} Jul 22 02:17:04.494545 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:04.494495 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bmwlm" podStartSLOduration=4.447958747 podStartE2EDuration="24.494478133s" totalImagesPullingTime="20.046519386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:03.506581192 +0000 UTC m=+24.615000528" watchObservedRunningTime="2026-07-22 02:17:04.494478133 +0000 UTC m=+25.602897469" Jul 22 02:17:05.484855 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:05.484815 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" event={"ID":"1e145c77-ffbb-4a29-8b35-d7c949a16215","Type":"ContainerStarted","Data":"52618459e3727acd45208b9ccd55f62faec57e31ebd6ab79d6b4ba813e464b05"} Jul 22 02:17:05.487217 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:05.487190 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" event={"ID":"f25eed9e-6c88-419b-a963-9097079cf48c","Type":"ContainerStarted","Data":"f66a10b2e36e91656434e97546030fe586136a414da443766da81e56b02cc0e5"} Jul 22 02:17:05.513356 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:05.513296 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-41.ec2.internal" podStartSLOduration=25.513275408 podStartE2EDuration="25.513275408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:04.494653615 +0000 UTC m=+25.603072968" watchObservedRunningTime="2026-07-22 02:17:05.513275408 +0000 UTC m=+26.621694745" Jul 22 02:17:05.513656 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:05.513614 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwx8w" podStartSLOduration=2.902795657 podStartE2EDuration="25.513606693s" totalImagesPullingTime="22.610811036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:05.512684223 +0000 UTC m=+26.621103560" watchObservedRunningTime="2026-07-22 02:17:05.513606693 +0000 UTC m=+26.622026029" Jul 22 02:17:05.611807 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:05.611773 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqx7f_241b6cf2-254d-4233-8d0a-0b373bd1236d/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:05.732004 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:05.731971 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqx7f_241b6cf2-254d-4233-8d0a-0b373bd1236d/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:05.845230 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:05.845150 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqx7f_241b6cf2-254d-4233-8d0a-0b373bd1236d/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:06.252339 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:06.252269 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:06.252513 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:06.252384 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:06.252513 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:06.252392 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:17:06.252513 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:06.252419 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:06.252698 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:06.252521 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:17:06.252698 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:06.252621 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:17:06.522594 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:06.522498 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqx7f_241b6cf2-254d-4233-8d0a-0b373bd1236d/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:06.606433 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:06.606352 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pqx7f" Jul 22 02:17:06.607084 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:06.607063 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pqx7f" Jul 22 02:17:06.829375 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:06.829346 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5bgxb_74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365/dns-node-resolver/0.log" Jul 22 02:17:07.493258 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:07.492962 2556 generic.go:356] "Generic (PLEG): container finished" podID="88ba46ca-7b85-49ff-a952-f5e94af52408" containerID="71113be7caeb406689cd6dcbf6fc7cfe866debc6315bd0645625c8aa70057162" exitCode=0 Jul 22 02:17:07.493493 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:07.493047 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnvr9" event={"ID":"88ba46ca-7b85-49ff-a952-f5e94af52408","Type":"ContainerDied","Data":"71113be7caeb406689cd6dcbf6fc7cfe866debc6315bd0645625c8aa70057162"} Jul 22 02:17:07.497146 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:07.497118 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" event={"ID":"1e145c77-ffbb-4a29-8b35-d7c949a16215","Type":"ContainerStarted","Data":"79ebba18ca9e86adea4e831fde3cb6f734526ca3cba435fdb3f5e13558777baa"} Jul 22 02:17:07.497243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:07.497203 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pqx7f" Jul 22 02:17:07.497777 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:07.497762 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pqx7f" Jul 22 02:17:07.558099 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:07.558047 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" podStartSLOduration=7.071739592 podStartE2EDuration="27.558033288s" totalImagesPullingTime="20.486293696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:07.556564889 +0000 UTC m=+28.664984226" watchObservedRunningTime="2026-07-22 02:17:07.558033288 +0000 UTC m=+28.666452623" Jul 22 02:17:08.028766 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:08.028738 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9r7nk_19b441a9-443f-4cac-8a30-d9fd5e4a4cca/node-ca/0.log" Jul 22 02:17:08.252735 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:08.252711 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:08.252735 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:08.252722 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:08.252973 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:08.252836 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:17:08.252973 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:08.252911 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:17:08.252973 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:08.252964 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:08.253105 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:08.253048 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:17:08.500991 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:08.500371 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:17:08.500991 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:08.500458 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:17:08.500991 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:08.500504 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:17:08.519757 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:08.519357 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:17:08.519757 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:08.519506 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:17:08.826357 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:08.826038 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rxh5h"] Jul 22 02:17:08.826907 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:08.826372 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:08.826907 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:08.826476 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:17:08.826907 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:08.826882 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hmqt5"] Jul 22 02:17:08.827050 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:08.826983 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:08.827090 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:08.827061 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:17:08.829995 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:08.829973 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-548xn"] Jul 22 02:17:08.830126 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:08.830056 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:08.830184 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:08.830126 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:17:09.504138 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:09.504101 2556 generic.go:356] "Generic (PLEG): container finished" podID="88ba46ca-7b85-49ff-a952-f5e94af52408" containerID="4c617462d895b0bd2f10834946163c5af7b8865b593edaafc0c647610dec34f5" exitCode=0 Jul 22 02:17:09.504289 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:09.504166 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnvr9" event={"ID":"88ba46ca-7b85-49ff-a952-f5e94af52408","Type":"ContainerDied","Data":"4c617462d895b0bd2f10834946163c5af7b8865b593edaafc0c647610dec34f5"} Jul 22 02:17:10.253042 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:10.253019 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:10.253453 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:10.253129 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:17:10.253453 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:10.253244 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:10.253453 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:10.253367 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:17:10.508631 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:10.508547 2556 generic.go:356] "Generic (PLEG): container finished" podID="88ba46ca-7b85-49ff-a952-f5e94af52408" containerID="99e4661e5a3f844d25845c2923d8121dae47b864b4f5e726f8f7469910ef69b4" exitCode=0 Jul 22 02:17:10.508769 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:10.508623 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnvr9" event={"ID":"88ba46ca-7b85-49ff-a952-f5e94af52408","Type":"ContainerDied","Data":"99e4661e5a3f844d25845c2923d8121dae47b864b4f5e726f8f7469910ef69b4"} Jul 22 02:17:11.248540 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:11.248468 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:11.248754 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:11.248575 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:17:12.234504 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:12.234462 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret\") pod \"global-pull-secret-syncer-rxh5h\" (UID: \"7f8aa8dc-6c8f-4e21-84be-429e861b5fa0\") " pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:12.235003 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:12.234657 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:17:12.235003 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:12.234748 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret podName:7f8aa8dc-6c8f-4e21-84be-429e861b5fa0 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:44.2347271 +0000 UTC m=+65.343146435 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret") pod "global-pull-secret-syncer-rxh5h" (UID: "7f8aa8dc-6c8f-4e21-84be-429e861b5fa0") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:17:12.249171 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:12.249139 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:12.249371 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:12.249278 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:17:12.249371 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:12.249317 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:12.249459 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:12.249404 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:17:12.335801 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:12.335768 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs\") pod \"network-metrics-daemon-hmqt5\" (UID: \"c581daf0-338d-43d1-923f-6283ebe6405a\") " pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:12.335975 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:12.335890 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:17:12.335975 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:12.335960 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs podName:c581daf0-338d-43d1-923f-6283ebe6405a nodeName:}" failed. No retries permitted until 2026-07-22 02:17:44.335940686 +0000 UTC m=+65.444360012 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs") pod "network-metrics-daemon-hmqt5" (UID: "c581daf0-338d-43d1-923f-6283ebe6405a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:17:12.436765 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:12.436724 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq2d5\" (UniqueName: \"kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5\") pod \"network-check-target-548xn\" (UID: \"78545e6e-eee9-4191-a1d3-66ef62a849c6\") " pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:12.436930 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:12.436890 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:17:12.436930 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:12.436917 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:17:12.437008 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:12.436933 2556 projected.go:196] Error preparing data for projected volume kube-api-access-pq2d5 for pod openshift-network-diagnostics/network-check-target-548xn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:17:12.437008 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:12.436995 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5 podName:78545e6e-eee9-4191-a1d3-66ef62a849c6 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:44.436980652 +0000 UTC m=+65.545399970 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pq2d5" (UniqueName: "kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5") pod "network-check-target-548xn" (UID: "78545e6e-eee9-4191-a1d3-66ef62a849c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:17:13.248236 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:13.248200 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:13.248729 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:13.248342 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:17:14.248584 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:14.248536 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:14.248584 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:14.248580 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:14.249125 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:14.248709 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:17:14.249125 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:14.248822 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:17:15.248568 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:15.248538 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:15.248754 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:15.248653 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:17:15.523611 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:15.523384 2556 generic.go:356] "Generic (PLEG): container finished" podID="88ba46ca-7b85-49ff-a952-f5e94af52408" containerID="78aac7706076dafb40b3614cd31652c64077dc20f41d0e55eabdc904ff872c8e" exitCode=0 Jul 22 02:17:15.523611 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:15.523471 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnvr9" event={"ID":"88ba46ca-7b85-49ff-a952-f5e94af52408","Type":"ContainerDied","Data":"78aac7706076dafb40b3614cd31652c64077dc20f41d0e55eabdc904ff872c8e"} Jul 22 02:17:16.249192 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:16.249159 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:16.249668 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:16.249264 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:17:16.249668 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:16.249329 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:16.249668 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:16.249449 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:17:16.528374 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:16.528287 2556 generic.go:356] "Generic (PLEG): container finished" podID="88ba46ca-7b85-49ff-a952-f5e94af52408" containerID="7cb7b0bd07903788c858a48550c82ad13d4acf5de391bc68a3059200941e3eee" exitCode=0 Jul 22 02:17:16.528374 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:16.528353 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnvr9" event={"ID":"88ba46ca-7b85-49ff-a952-f5e94af52408","Type":"ContainerDied","Data":"7cb7b0bd07903788c858a48550c82ad13d4acf5de391bc68a3059200941e3eee"} Jul 22 02:17:17.248295 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:17.248261 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:17.248464 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:17.248365 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:17:17.534475 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:17.534395 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnvr9" event={"ID":"88ba46ca-7b85-49ff-a952-f5e94af52408","Type":"ContainerStarted","Data":"f8c5022cca588c073fb99d5d14932854e271d7637fce7a28c7d7a7566d972963"} Jul 22 02:17:17.560247 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:17.560190 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cnvr9" podStartSLOduration=6.393504974 podStartE2EDuration="37.560171124s" totalImagesPullingTime="31.16666615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:17.55797197 +0000 UTC m=+38.666391317" watchObservedRunningTime="2026-07-22 02:17:17.560171124 +0000 UTC m=+38.668590460" Jul 22 02:17:18.248585 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:18.248550 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:18.248774 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:18.248550 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:18.248774 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:18.248696 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:17:18.248774 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:18.248758 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:17:19.248661 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:19.248618 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:19.249027 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:19.248734 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:17:20.249022 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:20.248981 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:20.249473 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:20.249369 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:17:20.249533 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:20.249509 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:20.251929 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:20.249683 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:17:21.248818 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:21.248785 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:21.249002 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:21.248893 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:17:22.248849 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:22.248820 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:22.249288 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:22.248929 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:17:22.249288 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:22.248997 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:22.249288 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:22.249115 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:17:23.248733 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:23.248708 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:23.248885 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:23.248803 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:17:24.248793 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:24.248757 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:24.248960 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:24.248756 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:24.248960 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:24.248875 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:17:24.248960 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:24.248936 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:17:25.248921 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:25.248885 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:25.249160 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:25.248986 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:17:26.248677 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:26.248616 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:26.248677 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:26.248683 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:26.248938 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:26.248761 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:17:26.248938 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:26.248884 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:17:27.248775 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:27.248736 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:27.249146 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:27.248840 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:17:28.249002 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:28.248964 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:28.249470 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:28.249063 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:17:28.249470 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:28.249137 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:28.249470 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:28.249229 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:17:29.249101 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:29.249072 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:29.249485 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:29.249170 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-548xn" podUID="78545e6e-eee9-4191-a1d3-66ef62a849c6" Jul 22 02:17:30.249221 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.249190 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:30.249583 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:30.249268 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxh5h" podUID="7f8aa8dc-6c8f-4e21-84be-429e861b5fa0" Jul 22 02:17:30.249583 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.249297 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:30.249583 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:30.249360 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmqt5" podUID="c581daf0-338d-43d1-923f-6283ebe6405a" Jul 22 02:17:30.655476 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.655400 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-41.ec2.internal" event="NodeReady" Jul 22 02:17:30.655604 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.655531 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 22 02:17:30.784497 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.784464 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6454596bcc-pv7r7"] Jul 22 02:17:30.796487 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.796456 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.799988 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.799959 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 22 02:17:30.800127 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.800049 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 22 02:17:30.800285 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.800270 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vnb92\"" Jul 22 02:17:30.800365 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.800303 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 22 02:17:30.807474 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.807451 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lh48z"] Jul 22 02:17:30.809231 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.809210 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 22 02:17:30.828778 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.828748 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6454596bcc-pv7r7"] Jul 22 02:17:30.828901 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.828790 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-c7prs"] Jul 22 02:17:30.828947 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.828895 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lh48z" Jul 22 02:17:30.833125 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.833097 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 22 02:17:30.833125 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.833124 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 22 02:17:30.833899 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.833879 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 22 02:17:30.834400 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.834378 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vv7c5\"" Jul 22 02:17:30.834919 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.834902 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 22 02:17:30.854179 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.854089 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lh48z"] Jul 22 02:17:30.854334 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.854204 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c7prs"] Jul 22 02:17:30.854334 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.854242 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c7prs" Jul 22 02:17:30.857319 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.857292 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 22 02:17:30.857441 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.857346 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 22 02:17:30.863841 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.863821 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-ca-trust-extracted\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.863923 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.863848 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-bound-sa-token\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.863923 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.863882 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfscn\" (UniqueName: \"kubernetes.io/projected/5e66d38b-512a-49c6-ab30-ba61bf4a294d-kube-api-access-hfscn\") pod \"insights-runtime-extractor-lh48z\" (UID: \"5e66d38b-512a-49c6-ab30-ba61bf4a294d\") " pod="openshift-insights/insights-runtime-extractor-lh48z" Jul 22 02:17:30.863994 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.863918 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ee339cc-7398-4a73-bb10-205286f33a42-tmp-dir\") pod \"dns-default-c7prs\" (UID: \"2ee339cc-7398-4a73-bb10-205286f33a42\") " pod="openshift-dns/dns-default-c7prs" Jul 22 02:17:30.864027 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.864000 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-image-registry-private-configuration\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.864060 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.864025 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlzbp\" (UniqueName: \"kubernetes.io/projected/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-kube-api-access-xlzbp\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.864092 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.864060 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e66d38b-512a-49c6-ab30-ba61bf4a294d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lh48z\" (UID: \"5e66d38b-512a-49c6-ab30-ba61bf4a294d\") " pod="openshift-insights/insights-runtime-extractor-lh48z" Jul 22 02:17:30.864124 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.864096 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-registry-tls\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.864159 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.864123 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e66d38b-512a-49c6-ab30-ba61bf4a294d-crio-socket\") pod \"insights-runtime-extractor-lh48z\" (UID: \"5e66d38b-512a-49c6-ab30-ba61bf4a294d\") " pod="openshift-insights/insights-runtime-extractor-lh48z" Jul 22 02:17:30.864159 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.864149 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2ee339cc-7398-4a73-bb10-205286f33a42-config-volume\") pod \"dns-default-c7prs\" (UID: \"2ee339cc-7398-4a73-bb10-205286f33a42\") " pod="openshift-dns/dns-default-c7prs" Jul 22 02:17:30.864218 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.864208 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-registry-certificates\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.864250 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.864227 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-trusted-ca\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.864250 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.864244 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e66d38b-512a-49c6-ab30-ba61bf4a294d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lh48z\" (UID: \"5e66d38b-512a-49c6-ab30-ba61bf4a294d\") " pod="openshift-insights/insights-runtime-extractor-lh48z" Jul 22 02:17:30.864311 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.864260 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ee339cc-7398-4a73-bb10-205286f33a42-metrics-tls\") pod \"dns-default-c7prs\" (UID: \"2ee339cc-7398-4a73-bb10-205286f33a42\") " pod="openshift-dns/dns-default-c7prs" Jul 22 02:17:30.864311 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.864291 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e66d38b-512a-49c6-ab30-ba61bf4a294d-data-volume\") pod \"insights-runtime-extractor-lh48z\" (UID: \"5e66d38b-512a-49c6-ab30-ba61bf4a294d\") " pod="openshift-insights/insights-runtime-extractor-lh48z" Jul 22 02:17:30.864370 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.864309 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-installation-pull-secrets\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.864370 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.864333 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwbsh\" (UniqueName: \"kubernetes.io/projected/2ee339cc-7398-4a73-bb10-205286f33a42-kube-api-access-gwbsh\") pod \"dns-default-c7prs\" (UID: \"2ee339cc-7398-4a73-bb10-205286f33a42\") " pod="openshift-dns/dns-default-c7prs" Jul 22 02:17:30.878565 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.878545 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-btqc6\"" Jul 22 02:17:30.935466 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.935435 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2lcb6"] Jul 22 02:17:30.954826 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.954801 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2lcb6"] Jul 22 02:17:30.954959 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.954883 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2lcb6" Jul 22 02:17:30.959339 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.959316 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 22 02:17:30.959469 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.959383 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9s7nv\"" Jul 22 02:17:30.959469 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.959448 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 22 02:17:30.959672 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.959655 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 22 02:17:30.965356 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.965336 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-registry-certificates\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.965461 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.965372 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-trusted-ca\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.965461 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.965399 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e66d38b-512a-49c6-ab30-ba61bf4a294d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lh48z\" (UID: \"5e66d38b-512a-49c6-ab30-ba61bf4a294d\") " pod="openshift-insights/insights-runtime-extractor-lh48z" Jul 22 02:17:30.965573 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.965507 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ee339cc-7398-4a73-bb10-205286f33a42-metrics-tls\") pod \"dns-default-c7prs\" (UID: \"2ee339cc-7398-4a73-bb10-205286f33a42\") " pod="openshift-dns/dns-default-c7prs" Jul 22 02:17:30.965573 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.965535 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e66d38b-512a-49c6-ab30-ba61bf4a294d-data-volume\") pod \"insights-runtime-extractor-lh48z\" (UID: \"5e66d38b-512a-49c6-ab30-ba61bf4a294d\") " pod="openshift-insights/insights-runtime-extractor-lh48z" Jul 22 02:17:30.965573 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.965558 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-installation-pull-secrets\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.965742 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.965589 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwbsh\" (UniqueName: \"kubernetes.io/projected/2ee339cc-7398-4a73-bb10-205286f33a42-kube-api-access-gwbsh\") pod \"dns-default-c7prs\" (UID: \"2ee339cc-7398-4a73-bb10-205286f33a42\") " pod="openshift-dns/dns-default-c7prs" Jul 22 02:17:30.965742 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.965657 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-ca-trust-extracted\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.965742 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.965680 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-bound-sa-token\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.965742 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.965732 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfscn\" (UniqueName: \"kubernetes.io/projected/5e66d38b-512a-49c6-ab30-ba61bf4a294d-kube-api-access-hfscn\") pod \"insights-runtime-extractor-lh48z\" (UID: \"5e66d38b-512a-49c6-ab30-ba61bf4a294d\") " pod="openshift-insights/insights-runtime-extractor-lh48z" Jul 22 02:17:30.965935 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.965757 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ee339cc-7398-4a73-bb10-205286f33a42-tmp-dir\") pod \"dns-default-c7prs\" (UID: \"2ee339cc-7398-4a73-bb10-205286f33a42\") " pod="openshift-dns/dns-default-c7prs" Jul 22 02:17:30.965935 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.965794 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-image-registry-private-configuration\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.965935 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.965819 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlzbp\" (UniqueName: \"kubernetes.io/projected/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-kube-api-access-xlzbp\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.965935 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.965843 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e66d38b-512a-49c6-ab30-ba61bf4a294d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lh48z\" (UID: \"5e66d38b-512a-49c6-ab30-ba61bf4a294d\") " pod="openshift-insights/insights-runtime-extractor-lh48z" Jul 22 02:17:30.965935 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.965854 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e66d38b-512a-49c6-ab30-ba61bf4a294d-data-volume\") pod \"insights-runtime-extractor-lh48z\" (UID: \"5e66d38b-512a-49c6-ab30-ba61bf4a294d\") " pod="openshift-insights/insights-runtime-extractor-lh48z" Jul 22 02:17:30.965935 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.965893 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-registry-tls\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.965935 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.965917 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e66d38b-512a-49c6-ab30-ba61bf4a294d-crio-socket\") pod \"insights-runtime-extractor-lh48z\" (UID: \"5e66d38b-512a-49c6-ab30-ba61bf4a294d\") " pod="openshift-insights/insights-runtime-extractor-lh48z" Jul 22 02:17:30.966264 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.965940 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2ee339cc-7398-4a73-bb10-205286f33a42-config-volume\") pod \"dns-default-c7prs\" (UID: \"2ee339cc-7398-4a73-bb10-205286f33a42\") " pod="openshift-dns/dns-default-c7prs" Jul 22 02:17:30.966264 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.966026 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e66d38b-512a-49c6-ab30-ba61bf4a294d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lh48z\" (UID: \"5e66d38b-512a-49c6-ab30-ba61bf4a294d\") " pod="openshift-insights/insights-runtime-extractor-lh48z" Jul 22 02:17:30.966370 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.966305 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-registry-certificates\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.966769 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.966498 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-trusted-ca\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.966769 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.966510 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2ee339cc-7398-4a73-bb10-205286f33a42-config-volume\") pod \"dns-default-c7prs\" (UID: \"2ee339cc-7398-4a73-bb10-205286f33a42\") " pod="openshift-dns/dns-default-c7prs" Jul 22 02:17:30.966769 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.966517 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-ca-trust-extracted\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.966769 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.966560 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ee339cc-7398-4a73-bb10-205286f33a42-tmp-dir\") pod \"dns-default-c7prs\" (UID: \"2ee339cc-7398-4a73-bb10-205286f33a42\") " pod="openshift-dns/dns-default-c7prs" Jul 22 02:17:30.966769 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.966676 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e66d38b-512a-49c6-ab30-ba61bf4a294d-crio-socket\") pod \"insights-runtime-extractor-lh48z\" (UID: \"5e66d38b-512a-49c6-ab30-ba61bf4a294d\") " pod="openshift-insights/insights-runtime-extractor-lh48z" Jul 22 02:17:30.969692 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.969657 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e66d38b-512a-49c6-ab30-ba61bf4a294d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lh48z\" (UID: \"5e66d38b-512a-49c6-ab30-ba61bf4a294d\") " pod="openshift-insights/insights-runtime-extractor-lh48z" Jul 22 02:17:30.969796 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.969778 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ee339cc-7398-4a73-bb10-205286f33a42-metrics-tls\") pod \"dns-default-c7prs\" (UID: \"2ee339cc-7398-4a73-bb10-205286f33a42\") " pod="openshift-dns/dns-default-c7prs" Jul 22 02:17:30.969840 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.969816 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-registry-tls\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.969897 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.969873 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-installation-pull-secrets\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.969933 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.969875 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-image-registry-private-configuration\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.977833 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.977810 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlzbp\" (UniqueName: \"kubernetes.io/projected/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-kube-api-access-xlzbp\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.978165 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.978134 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfscn\" (UniqueName: \"kubernetes.io/projected/5e66d38b-512a-49c6-ab30-ba61bf4a294d-kube-api-access-hfscn\") pod \"insights-runtime-extractor-lh48z\" (UID: \"5e66d38b-512a-49c6-ab30-ba61bf4a294d\") " pod="openshift-insights/insights-runtime-extractor-lh48z" Jul 22 02:17:30.978331 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.978312 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96d1ad8a-bfeb-401a-9734-ad3aeda4668f-bound-sa-token\") pod \"image-registry-6454596bcc-pv7r7\" (UID: \"96d1ad8a-bfeb-401a-9734-ad3aeda4668f\") " pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:30.979355 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:30.979335 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwbsh\" (UniqueName: \"kubernetes.io/projected/2ee339cc-7398-4a73-bb10-205286f33a42-kube-api-access-gwbsh\") pod \"dns-default-c7prs\" (UID: \"2ee339cc-7398-4a73-bb10-205286f33a42\") " pod="openshift-dns/dns-default-c7prs" Jul 22 02:17:31.066620 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.066576 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlxvh\" (UniqueName: \"kubernetes.io/projected/17f9eb80-402d-400a-a3a8-92188048c547-kube-api-access-nlxvh\") pod \"ingress-canary-2lcb6\" (UID: \"17f9eb80-402d-400a-a3a8-92188048c547\") " pod="openshift-ingress-canary/ingress-canary-2lcb6" Jul 22 02:17:31.066834 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.066632 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17f9eb80-402d-400a-a3a8-92188048c547-cert\") pod \"ingress-canary-2lcb6\" (UID: \"17f9eb80-402d-400a-a3a8-92188048c547\") " pod="openshift-ingress-canary/ingress-canary-2lcb6" Jul 22 02:17:31.106119 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.106083 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:31.138764 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.138736 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lh48z" Jul 22 02:17:31.162510 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.162470 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c7prs" Jul 22 02:17:31.167521 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.167492 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlxvh\" (UniqueName: \"kubernetes.io/projected/17f9eb80-402d-400a-a3a8-92188048c547-kube-api-access-nlxvh\") pod \"ingress-canary-2lcb6\" (UID: \"17f9eb80-402d-400a-a3a8-92188048c547\") " pod="openshift-ingress-canary/ingress-canary-2lcb6" Jul 22 02:17:31.167665 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.167549 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17f9eb80-402d-400a-a3a8-92188048c547-cert\") pod \"ingress-canary-2lcb6\" (UID: \"17f9eb80-402d-400a-a3a8-92188048c547\") " pod="openshift-ingress-canary/ingress-canary-2lcb6" Jul 22 02:17:31.169980 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.169952 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17f9eb80-402d-400a-a3a8-92188048c547-cert\") pod \"ingress-canary-2lcb6\" (UID: \"17f9eb80-402d-400a-a3a8-92188048c547\") " pod="openshift-ingress-canary/ingress-canary-2lcb6" Jul 22 02:17:31.175847 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.175826 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlxvh\" (UniqueName: \"kubernetes.io/projected/17f9eb80-402d-400a-a3a8-92188048c547-kube-api-access-nlxvh\") pod \"ingress-canary-2lcb6\" (UID: \"17f9eb80-402d-400a-a3a8-92188048c547\") " pod="openshift-ingress-canary/ingress-canary-2lcb6" Jul 22 02:17:31.250588 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.249689 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:31.254244 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.253475 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 02:17:31.254244 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.253540 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 02:17:31.254244 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.253563 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ngk6m\"" Jul 22 02:17:31.263025 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.263002 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2lcb6" Jul 22 02:17:31.283411 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.283380 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6454596bcc-pv7r7"] Jul 22 02:17:31.300744 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.300719 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lh48z"] Jul 22 02:17:31.303661 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:17:31.303618 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e66d38b_512a_49c6_ab30_ba61bf4a294d.slice/crio-06df00b92290228a288dd8f75bf689da18ea7a41c7f9ac63d4996e578d9adda0 WatchSource:0}: Error finding container 06df00b92290228a288dd8f75bf689da18ea7a41c7f9ac63d4996e578d9adda0: Status 404 returned error can't find the container with id 06df00b92290228a288dd8f75bf689da18ea7a41c7f9ac63d4996e578d9adda0 Jul 22 02:17:31.325165 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.325072 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c7prs"] Jul 22 02:17:31.329447 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:17:31.329420 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ee339cc_7398_4a73_bb10_205286f33a42.slice/crio-59b803f100a1e847e42d964ae56699e9fc349a340760461ad250aaad373988ff WatchSource:0}: Error finding container 59b803f100a1e847e42d964ae56699e9fc349a340760461ad250aaad373988ff: Status 404 returned error can't find the container with id 59b803f100a1e847e42d964ae56699e9fc349a340760461ad250aaad373988ff Jul 22 02:17:31.414125 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.414094 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2lcb6"] Jul 22 02:17:31.418415 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:17:31.418379 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f9eb80_402d_400a_a3a8_92188048c547.slice/crio-7d6ebcde01c943fb912c43c2a12a05b97e64961d839ee2cb6a8b18b634bbeca3 WatchSource:0}: Error finding container 7d6ebcde01c943fb912c43c2a12a05b97e64961d839ee2cb6a8b18b634bbeca3: Status 404 returned error can't find the container with id 7d6ebcde01c943fb912c43c2a12a05b97e64961d839ee2cb6a8b18b634bbeca3 Jul 22 02:17:31.566594 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.566561 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2lcb6" event={"ID":"17f9eb80-402d-400a-a3a8-92188048c547","Type":"ContainerStarted","Data":"7d6ebcde01c943fb912c43c2a12a05b97e64961d839ee2cb6a8b18b634bbeca3"} Jul 22 02:17:31.568113 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.568086 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" event={"ID":"96d1ad8a-bfeb-401a-9734-ad3aeda4668f","Type":"ContainerStarted","Data":"798a3c258a64426c98c63fa980891983af74415554fa640d4a80bcf364c34f4d"} Jul 22 02:17:31.568235 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.568130 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" event={"ID":"96d1ad8a-bfeb-401a-9734-ad3aeda4668f","Type":"ContainerStarted","Data":"f21133a34dfdb677e80967f4828efbf739a7001152f06bc00f942e5e7230d06d"} Jul 22 02:17:31.568235 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.568175 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:31.569323 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.569300 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c7prs" event={"ID":"2ee339cc-7398-4a73-bb10-205286f33a42","Type":"ContainerStarted","Data":"59b803f100a1e847e42d964ae56699e9fc349a340760461ad250aaad373988ff"} Jul 22 02:17:31.570389 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.570369 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lh48z" event={"ID":"5e66d38b-512a-49c6-ab30-ba61bf4a294d","Type":"ContainerStarted","Data":"06df00b92290228a288dd8f75bf689da18ea7a41c7f9ac63d4996e578d9adda0"} Jul 22 02:17:31.587518 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:31.587460 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" podStartSLOduration=1.587442496 podStartE2EDuration="1.587442496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:31.587006653 +0000 UTC m=+52.695426009" watchObservedRunningTime="2026-07-22 02:17:31.587442496 +0000 UTC m=+52.695861811" Jul 22 02:17:32.251676 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:32.251625 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:32.252230 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:32.251893 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:32.256360 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:32.256333 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r8wr9\"" Jul 22 02:17:32.256501 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:32.256359 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 02:17:32.256558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:32.256516 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 02:17:35.532389 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.532352 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bf75bcfbf-h6jgd"] Jul 22 02:17:35.540393 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.540366 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:35.543340 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.543316 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 22 02:17:35.544735 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.544708 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 22 02:17:35.544735 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.544729 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 22 02:17:35.544900 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.544735 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lmd2l\"" Jul 22 02:17:35.545149 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.545130 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 22 02:17:35.545264 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.545242 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 22 02:17:35.545441 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.545398 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 22 02:17:35.545518 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.545454 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 22 02:17:35.547378 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.547322 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bf75bcfbf-h6jgd"] Jul 22 02:17:35.602197 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.602165 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-console-serving-cert\") pod \"console-6bf75bcfbf-h6jgd\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:35.602197 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.602204 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-oauth-serving-cert\") pod \"console-6bf75bcfbf-h6jgd\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:35.602431 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.602226 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-service-ca\") pod \"console-6bf75bcfbf-h6jgd\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:35.602431 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.602292 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffd57\" (UniqueName: \"kubernetes.io/projected/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-kube-api-access-ffd57\") pod \"console-6bf75bcfbf-h6jgd\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:35.602539 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.602424 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-console-oauth-config\") pod \"console-6bf75bcfbf-h6jgd\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:35.602539 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.602463 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-console-config\") pod \"console-6bf75bcfbf-h6jgd\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:35.703124 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.703080 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-service-ca\") pod \"console-6bf75bcfbf-h6jgd\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:35.703317 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.703151 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffd57\" (UniqueName: \"kubernetes.io/projected/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-kube-api-access-ffd57\") pod \"console-6bf75bcfbf-h6jgd\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:35.703317 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.703228 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-console-oauth-config\") pod \"console-6bf75bcfbf-h6jgd\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:35.703317 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.703250 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-console-config\") pod \"console-6bf75bcfbf-h6jgd\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:35.703482 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.703326 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-console-serving-cert\") pod \"console-6bf75bcfbf-h6jgd\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:35.703482 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.703357 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-oauth-serving-cert\") pod \"console-6bf75bcfbf-h6jgd\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:35.704156 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.703963 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-service-ca\") pod \"console-6bf75bcfbf-h6jgd\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:35.704156 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.704114 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-console-config\") pod \"console-6bf75bcfbf-h6jgd\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:35.704380 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.704360 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-oauth-serving-cert\") pod \"console-6bf75bcfbf-h6jgd\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:35.705970 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.705950 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-console-oauth-config\") pod \"console-6bf75bcfbf-h6jgd\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:35.706144 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.706125 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-console-serving-cert\") pod \"console-6bf75bcfbf-h6jgd\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:35.712827 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.712778 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffd57\" (UniqueName: \"kubernetes.io/projected/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-kube-api-access-ffd57\") pod \"console-6bf75bcfbf-h6jgd\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:35.850883 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:35.850796 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:37.221893 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:37.221855 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bf75bcfbf-h6jgd"] Jul 22 02:17:37.589317 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:37.589284 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2lcb6" event={"ID":"17f9eb80-402d-400a-a3a8-92188048c547","Type":"ContainerStarted","Data":"708b9db3281a644c97ae5de2457d24413a478f0168742cc48c7edb559c59e41c"} Jul 22 02:17:37.590540 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:37.590513 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bf75bcfbf-h6jgd" event={"ID":"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8","Type":"ContainerStarted","Data":"718918d1355fe21c1cbd4a46459528ee55c82a08661253ce5e1e8479e76db49c"} Jul 22 02:17:37.592135 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:37.592112 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c7prs" event={"ID":"2ee339cc-7398-4a73-bb10-205286f33a42","Type":"ContainerStarted","Data":"f545f2382e52abf69b6f7beacdf00e8911a796f54a260930f959fb6f3f466d42"} Jul 22 02:17:37.592247 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:37.592149 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c7prs" event={"ID":"2ee339cc-7398-4a73-bb10-205286f33a42","Type":"ContainerStarted","Data":"01d99895d8b6635ed81aa6bc269caef2184a8a784c7374a36c320c652acddf98"} Jul 22 02:17:37.592247 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:37.592228 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-c7prs" Jul 22 02:17:37.593541 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:37.593524 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lh48z" event={"ID":"5e66d38b-512a-49c6-ab30-ba61bf4a294d","Type":"ContainerStarted","Data":"1cc0dfee52160fdd24474fefa2a7979870ee7870b62fb127758f86f995b408f8"} Jul 22 02:17:37.605843 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:37.605799 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2lcb6" podStartSLOduration=1.9473398259999999 podStartE2EDuration="7.605785232s" totalImagesPullingTime="5.658445406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:37.604812743 +0000 UTC m=+58.713232079" watchObservedRunningTime="2026-07-22 02:17:37.605785232 +0000 UTC m=+58.714204545" Jul 22 02:17:37.622336 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:37.622284 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-c7prs" podStartSLOduration=2.54102484 podStartE2EDuration="7.622267285s" totalImagesPullingTime="5.081242445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:37.621754353 +0000 UTC m=+58.730173690" watchObservedRunningTime="2026-07-22 02:17:37.622267285 +0000 UTC m=+58.730686623" Jul 22 02:17:40.521074 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:40.521039 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zn9wn" Jul 22 02:17:42.610972 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:42.610877 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lh48z" event={"ID":"5e66d38b-512a-49c6-ab30-ba61bf4a294d","Type":"ContainerStarted","Data":"e4419da1d8abf8e131e934b82eac733a3c8352889328f5da44f278e54d9d5088"} Jul 22 02:17:42.612324 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:42.612294 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bf75bcfbf-h6jgd" event={"ID":"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8","Type":"ContainerStarted","Data":"b337fb11c5c54d4d9a887f6ba53701e0e2d2b3db01f5516be2d605ba5d93de84"} Jul 22 02:17:42.631127 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:42.631080 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bf75bcfbf-h6jgd" podStartSLOduration=2.618952717 podStartE2EDuration="7.631063346s" totalImagesPullingTime="5.012110629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:42.629915407 +0000 UTC m=+63.738334755" watchObservedRunningTime="2026-07-22 02:17:42.631063346 +0000 UTC m=+63.739482681" Jul 22 02:17:44.270581 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:44.270548 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret\") pod \"global-pull-secret-syncer-rxh5h\" (UID: \"7f8aa8dc-6c8f-4e21-84be-429e861b5fa0\") " pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:44.273849 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:44.273826 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 02:17:44.284134 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:44.284108 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f8aa8dc-6c8f-4e21-84be-429e861b5fa0-original-pull-secret\") pod \"global-pull-secret-syncer-rxh5h\" (UID: \"7f8aa8dc-6c8f-4e21-84be-429e861b5fa0\") " pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:44.287036 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:44.287014 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxh5h" Jul 22 02:17:44.371803 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:44.371765 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs\") pod \"network-metrics-daemon-hmqt5\" (UID: \"c581daf0-338d-43d1-923f-6283ebe6405a\") " pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:44.375123 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:44.375102 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 02:17:44.384952 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:44.384927 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c581daf0-338d-43d1-923f-6283ebe6405a-metrics-certs\") pod \"network-metrics-daemon-hmqt5\" (UID: \"c581daf0-338d-43d1-923f-6283ebe6405a\") " pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:44.472680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:44.472632 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq2d5\" (UniqueName: \"kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5\") pod \"network-check-target-548xn\" (UID: \"78545e6e-eee9-4191-a1d3-66ef62a849c6\") " pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:44.477717 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:44.477690 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 02:17:44.486744 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:44.486716 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 02:17:44.496995 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:44.496968 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq2d5\" (UniqueName: \"kubernetes.io/projected/78545e6e-eee9-4191-a1d3-66ef62a849c6-kube-api-access-pq2d5\") pod \"network-check-target-548xn\" (UID: \"78545e6e-eee9-4191-a1d3-66ef62a849c6\") " pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:44.582868 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:44.582791 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r8wr9\"" Jul 22 02:17:44.589491 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:44.589465 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmqt5" Jul 22 02:17:44.767084 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:44.767053 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ngk6m\"" Jul 22 02:17:44.774581 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:44.774547 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:45.851811 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:45.851779 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:45.852189 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:45.851860 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:45.853579 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:45.853544 2556 patch_prober.go:28] interesting pod/console-6bf75bcfbf-h6jgd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.10:8443/health\": dial tcp 10.133.0.10:8443: connect: connection refused" start-of-body= Jul 22 02:17:45.853714 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:45.853621 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6bf75bcfbf-h6jgd" podUID="d6a2d7be-5e7a-4282-acd6-36f49b9bafa8" containerName="console" probeResult="failure" output="Get \"https://10.133.0.10:8443/health\": dial tcp 10.133.0.10:8443: connect: connection refused" Jul 22 02:17:45.985602 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:45.985156 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-548xn"] Jul 22 02:17:45.989703 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:17:45.989674 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78545e6e_eee9_4191_a1d3_66ef62a849c6.slice/crio-1669a8f51c3b1820842ac671138eb8cba6845102c508fa8df83ece69889bfc8d WatchSource:0}: Error finding container 1669a8f51c3b1820842ac671138eb8cba6845102c508fa8df83ece69889bfc8d: Status 404 returned error can't find the container with id 1669a8f51c3b1820842ac671138eb8cba6845102c508fa8df83ece69889bfc8d Jul 22 02:17:46.001078 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:46.001053 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hmqt5"] Jul 22 02:17:46.004472 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:17:46.004447 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc581daf0_338d_43d1_923f_6283ebe6405a.slice/crio-abf025c774b5c78404130346cb66e226c95ac4e95b472cfdf913303eaeae21a3 WatchSource:0}: Error finding container abf025c774b5c78404130346cb66e226c95ac4e95b472cfdf913303eaeae21a3: Status 404 returned error can't find the container with id abf025c774b5c78404130346cb66e226c95ac4e95b472cfdf913303eaeae21a3 Jul 22 02:17:46.013456 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:46.013435 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rxh5h"] Jul 22 02:17:46.015972 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:17:46.015950 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f8aa8dc_6c8f_4e21_84be_429e861b5fa0.slice/crio-3994f44c3317f877732cefc093001f19c3cd71b87cd1748166408f81e0668a8d WatchSource:0}: Error finding container 3994f44c3317f877732cefc093001f19c3cd71b87cd1748166408f81e0668a8d: Status 404 returned error can't find the container with id 3994f44c3317f877732cefc093001f19c3cd71b87cd1748166408f81e0668a8d Jul 22 02:17:46.638284 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:46.638242 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lh48z" event={"ID":"5e66d38b-512a-49c6-ab30-ba61bf4a294d","Type":"ContainerStarted","Data":"27b4433ef8dc8ca935fefeeedaaa99a11282393662d2bf343edde1b8a09734b3"} Jul 22 02:17:46.640088 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:46.640003 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rxh5h" event={"ID":"7f8aa8dc-6c8f-4e21-84be-429e861b5fa0","Type":"ContainerStarted","Data":"3994f44c3317f877732cefc093001f19c3cd71b87cd1748166408f81e0668a8d"} Jul 22 02:17:46.641466 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:46.641438 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-548xn" event={"ID":"78545e6e-eee9-4191-a1d3-66ef62a849c6","Type":"ContainerStarted","Data":"1669a8f51c3b1820842ac671138eb8cba6845102c508fa8df83ece69889bfc8d"} Jul 22 02:17:46.643331 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:46.643267 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hmqt5" event={"ID":"c581daf0-338d-43d1-923f-6283ebe6405a","Type":"ContainerStarted","Data":"abf025c774b5c78404130346cb66e226c95ac4e95b472cfdf913303eaeae21a3"} Jul 22 02:17:46.658574 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:46.658096 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lh48z" podStartSLOduration=2.213857058 podStartE2EDuration="16.658076504s" totalImagesPullingTime="14.444219446s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:17:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:46.657112423 +0000 UTC m=+67.765531759" watchObservedRunningTime="2026-07-22 02:17:46.658076504 +0000 UTC m=+67.766495843" Jul 22 02:17:47.599762 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:47.599727 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-c7prs" Jul 22 02:17:47.653144 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:47.653100 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hmqt5" event={"ID":"c581daf0-338d-43d1-923f-6283ebe6405a","Type":"ContainerStarted","Data":"4d6bb92f86011c722f4bbe6548aa8044ca8ff2bc8321af44eed79572101349d3"} Jul 22 02:17:47.653328 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:47.653160 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hmqt5" event={"ID":"c581daf0-338d-43d1-923f-6283ebe6405a","Type":"ContainerStarted","Data":"03652f9ca5cace7ed6e55cb99389dc5ff81e7783d027fcff6684f1ef4703e84b"} Jul 22 02:17:47.671337 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:47.671284 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hmqt5" podStartSLOduration=66.661142419 podStartE2EDuration="1m7.671267366s" totalImagesPullingTime="1.010124947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:47.67083385 +0000 UTC m=+68.779253183" watchObservedRunningTime="2026-07-22 02:17:47.671267366 +0000 UTC m=+68.779686705" Jul 22 02:17:50.664975 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:50.664929 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rxh5h" event={"ID":"7f8aa8dc-6c8f-4e21-84be-429e861b5fa0","Type":"ContainerStarted","Data":"c5ab6f57c901263d9d912d4c42e747be9bcfe2b43a0ea9ce66149b528ace1d67"} Jul 22 02:17:50.666426 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:50.666391 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-548xn" event={"ID":"78545e6e-eee9-4191-a1d3-66ef62a849c6","Type":"ContainerStarted","Data":"a308a40c303bd5a81d71c91b91a751a150f9550f9cee528c11545bdd90dd2fdc"} Jul 22 02:17:50.666536 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:50.666464 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:17:50.682319 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:50.682262 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rxh5h" podStartSLOduration=66.217890873 podStartE2EDuration="1m10.682243886s" totalImagesPullingTime="4.464353013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:50.681248813 +0000 UTC m=+71.789668151" watchObservedRunningTime="2026-07-22 02:17:50.682243886 +0000 UTC m=+71.790663224" Jul 22 02:17:50.697209 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:50.697152 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-548xn" podStartSLOduration=66.209796384 podStartE2EDuration="1m10.697133822s" totalImagesPullingTime="4.487337438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:50.696462349 +0000 UTC m=+71.804881715" watchObservedRunningTime="2026-07-22 02:17:50.697133822 +0000 UTC m=+71.805553157" Jul 22 02:17:51.111033 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.110994 2556 patch_prober.go:28] interesting pod/image-registry-6454596bcc-pv7r7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 22 02:17:51.111198 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.111042 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" podUID="96d1ad8a-bfeb-401a-9734-ad3aeda4668f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 02:17:51.144868 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.144833 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-86mnr"] Jul 22 02:17:51.147417 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.147389 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.150041 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.150019 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 22 02:17:51.150549 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.150528 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 22 02:17:51.150744 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.150727 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 22 02:17:51.151603 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.151583 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 22 02:17:51.151744 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.151588 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 22 02:17:51.151943 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.151926 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5k47c\"" Jul 22 02:17:51.152064 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.151968 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 22 02:17:51.226119 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.226077 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64c1cf9e-1333-452a-9658-28e622ebccb6-metrics-client-ca\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.226119 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.226116 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/64c1cf9e-1333-452a-9658-28e622ebccb6-root\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.226328 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.226157 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/64c1cf9e-1333-452a-9658-28e622ebccb6-node-exporter-accelerators-collector-config\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.226328 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.226218 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvrqk\" (UniqueName: \"kubernetes.io/projected/64c1cf9e-1333-452a-9658-28e622ebccb6-kube-api-access-zvrqk\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.226328 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.226249 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/64c1cf9e-1333-452a-9658-28e622ebccb6-node-exporter-wtmp\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.226328 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.226269 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64c1cf9e-1333-452a-9658-28e622ebccb6-sys\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.226328 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.226305 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64c1cf9e-1333-452a-9658-28e622ebccb6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.226482 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.226329 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/64c1cf9e-1333-452a-9658-28e622ebccb6-node-exporter-textfile\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.226482 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.226347 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/64c1cf9e-1333-452a-9658-28e622ebccb6-node-exporter-tls\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.327455 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.327419 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64c1cf9e-1333-452a-9658-28e622ebccb6-sys\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.327669 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.327466 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64c1cf9e-1333-452a-9658-28e622ebccb6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.327669 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.327499 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/64c1cf9e-1333-452a-9658-28e622ebccb6-node-exporter-textfile\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.327669 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.327525 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/64c1cf9e-1333-452a-9658-28e622ebccb6-node-exporter-tls\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.327669 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.327537 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64c1cf9e-1333-452a-9658-28e622ebccb6-sys\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.327669 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.327558 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64c1cf9e-1333-452a-9658-28e622ebccb6-metrics-client-ca\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.327669 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.327582 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/64c1cf9e-1333-452a-9658-28e622ebccb6-root\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.327669 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.327621 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/64c1cf9e-1333-452a-9658-28e622ebccb6-node-exporter-accelerators-collector-config\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.327669 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.327668 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvrqk\" (UniqueName: \"kubernetes.io/projected/64c1cf9e-1333-452a-9658-28e622ebccb6-kube-api-access-zvrqk\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.327984 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.327698 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/64c1cf9e-1333-452a-9658-28e622ebccb6-node-exporter-wtmp\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.327984 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.327723 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/64c1cf9e-1333-452a-9658-28e622ebccb6-root\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.327984 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.327882 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/64c1cf9e-1333-452a-9658-28e622ebccb6-node-exporter-wtmp\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.327984 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.327895 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/64c1cf9e-1333-452a-9658-28e622ebccb6-node-exporter-textfile\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.328403 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.328369 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/64c1cf9e-1333-452a-9658-28e622ebccb6-node-exporter-accelerators-collector-config\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.328403 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.328378 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64c1cf9e-1333-452a-9658-28e622ebccb6-metrics-client-ca\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.329964 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.329936 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/64c1cf9e-1333-452a-9658-28e622ebccb6-node-exporter-tls\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.330063 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.329997 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64c1cf9e-1333-452a-9658-28e622ebccb6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.336453 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.336433 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvrqk\" (UniqueName: \"kubernetes.io/projected/64c1cf9e-1333-452a-9658-28e622ebccb6-kube-api-access-zvrqk\") pod \"node-exporter-86mnr\" (UID: \"64c1cf9e-1333-452a-9658-28e622ebccb6\") " pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.457969 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.457931 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-86mnr" Jul 22 02:17:51.467053 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:17:51.467027 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c1cf9e_1333_452a_9658_28e622ebccb6.slice/crio-f356b1919e9a8d2edbf2dee7ef16c0614ba583578489aa71522b93339b0a0048 WatchSource:0}: Error finding container f356b1919e9a8d2edbf2dee7ef16c0614ba583578489aa71522b93339b0a0048: Status 404 returned error can't find the container with id f356b1919e9a8d2edbf2dee7ef16c0614ba583578489aa71522b93339b0a0048 Jul 22 02:17:51.674788 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:51.674753 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-86mnr" event={"ID":"64c1cf9e-1333-452a-9658-28e622ebccb6","Type":"ContainerStarted","Data":"f356b1919e9a8d2edbf2dee7ef16c0614ba583578489aa71522b93339b0a0048"} Jul 22 02:17:52.200966 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.200929 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 02:17:52.203398 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.203376 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.206381 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.206361 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 22 02:17:52.206479 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.206400 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 22 02:17:52.206479 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.206400 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 22 02:17:52.206607 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.206400 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 22 02:17:52.206888 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.206869 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 22 02:17:52.207035 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.207017 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9z4xd\"" Jul 22 02:17:52.207180 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.207153 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 22 02:17:52.207321 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.207307 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 22 02:17:52.207804 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.207788 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 22 02:17:52.208572 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.208551 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 22 02:17:52.219452 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.219425 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 02:17:52.336767 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.336736 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.336767 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.336776 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36536c18-c4ca-4929-b7fb-f8dea04daf42-config-out\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.336990 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.336795 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/36536c18-c4ca-4929-b7fb-f8dea04daf42-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.336990 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.336850 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.336990 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.336905 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36536c18-c4ca-4929-b7fb-f8dea04daf42-tls-assets\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.336990 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.336926 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36536c18-c4ca-4929-b7fb-f8dea04daf42-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.336990 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.336952 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-web-config\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.337198 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.337028 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.337198 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.337072 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-config-volume\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.337198 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.337132 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.337198 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.337191 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36536c18-c4ca-4929-b7fb-f8dea04daf42-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.337368 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.337220 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8rpc\" (UniqueName: \"kubernetes.io/projected/36536c18-c4ca-4929-b7fb-f8dea04daf42-kube-api-access-h8rpc\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.337368 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.337286 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.438263 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.438218 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.438457 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.438276 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-config-volume\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.438457 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.438305 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.438457 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.438348 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36536c18-c4ca-4929-b7fb-f8dea04daf42-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.438457 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.438373 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8rpc\" (UniqueName: \"kubernetes.io/projected/36536c18-c4ca-4929-b7fb-f8dea04daf42-kube-api-access-h8rpc\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.438457 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.438402 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.438457 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.438447 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.439026 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.438484 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36536c18-c4ca-4929-b7fb-f8dea04daf42-config-out\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.439026 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.438512 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/36536c18-c4ca-4929-b7fb-f8dea04daf42-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.439026 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.438551 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.439026 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.438587 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36536c18-c4ca-4929-b7fb-f8dea04daf42-tls-assets\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.439026 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.438612 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36536c18-c4ca-4929-b7fb-f8dea04daf42-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.439026 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.438677 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-web-config\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.439026 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:52.438953 2556 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 22 02:17:52.439367 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:17:52.439037 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-secret-alertmanager-main-tls podName:36536c18-c4ca-4929-b7fb-f8dea04daf42 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:52.93901033 +0000 UTC m=+74.047429659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "36536c18-c4ca-4929-b7fb-f8dea04daf42") : secret "alertmanager-main-tls" not found Jul 22 02:17:52.439912 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.439884 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36536c18-c4ca-4929-b7fb-f8dea04daf42-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.440009 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.439902 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36536c18-c4ca-4929-b7fb-f8dea04daf42-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.440799 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.440775 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/36536c18-c4ca-4929-b7fb-f8dea04daf42-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.442778 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.442672 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36536c18-c4ca-4929-b7fb-f8dea04daf42-tls-assets\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.442882 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.442840 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-web-config\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.443132 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.443106 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.443243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.443196 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36536c18-c4ca-4929-b7fb-f8dea04daf42-config-out\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.443336 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.443295 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-config-volume\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.443454 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.443404 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.443454 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.443425 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.444619 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.444597 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.447247 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.447226 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8rpc\" (UniqueName: \"kubernetes.io/projected/36536c18-c4ca-4929-b7fb-f8dea04daf42-kube-api-access-h8rpc\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.579608 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.579447 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6454596bcc-pv7r7" Jul 22 02:17:52.680899 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.680866 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-86mnr" event={"ID":"64c1cf9e-1333-452a-9658-28e622ebccb6","Type":"ContainerStarted","Data":"399a54581d5427ab3b2b06813e809e577e4c4b7d5ca604a99cb296abd4fe0f3d"} Jul 22 02:17:52.942233 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.942203 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:52.944529 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:52.944510 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/36536c18-c4ca-4929-b7fb-f8dea04daf42-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"36536c18-c4ca-4929-b7fb-f8dea04daf42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:53.114681 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:53.114609 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 02:17:53.250093 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:53.250069 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 02:17:53.250837 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:17:53.250811 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36536c18_c4ca_4929_b7fb_f8dea04daf42.slice/crio-86010be6ef8daf5b636dd7d5362b2a0fa83b592d36e897b7974cf871ea08716f WatchSource:0}: Error finding container 86010be6ef8daf5b636dd7d5362b2a0fa83b592d36e897b7974cf871ea08716f: Status 404 returned error can't find the container with id 86010be6ef8daf5b636dd7d5362b2a0fa83b592d36e897b7974cf871ea08716f Jul 22 02:17:53.685603 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:53.685567 2556 generic.go:356] "Generic (PLEG): container finished" podID="64c1cf9e-1333-452a-9658-28e622ebccb6" containerID="399a54581d5427ab3b2b06813e809e577e4c4b7d5ca604a99cb296abd4fe0f3d" exitCode=0 Jul 22 02:17:53.686010 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:53.685658 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-86mnr" event={"ID":"64c1cf9e-1333-452a-9658-28e622ebccb6","Type":"ContainerDied","Data":"399a54581d5427ab3b2b06813e809e577e4c4b7d5ca604a99cb296abd4fe0f3d"} Jul 22 02:17:53.686722 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:53.686701 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36536c18-c4ca-4929-b7fb-f8dea04daf42","Type":"ContainerStarted","Data":"86010be6ef8daf5b636dd7d5362b2a0fa83b592d36e897b7974cf871ea08716f"} Jul 22 02:17:54.110840 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.110749 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5db95b4bd5-pz54b"] Jul 22 02:17:54.113914 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.113891 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.117270 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.117244 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 22 02:17:54.119160 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.119026 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 22 02:17:54.119160 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.119051 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-d5o60m3ml5p37\"" Jul 22 02:17:54.119160 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.119053 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ml2hr\"" Jul 22 02:17:54.119160 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.119058 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 22 02:17:54.119160 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.119058 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 22 02:17:54.119483 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.119390 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 22 02:17:54.125678 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.125563 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5db95b4bd5-pz54b"] Jul 22 02:17:54.252277 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.252239 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-secret-grpc-tls\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.252437 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.252287 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-secret-thanos-querier-tls\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.252437 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.252313 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-metrics-client-ca\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.252437 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.252347 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.252437 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.252380 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.252630 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.252443 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.252630 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.252491 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.252630 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.252510 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz2v2\" (UniqueName: \"kubernetes.io/projected/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-kube-api-access-jz2v2\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.353377 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.353342 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.353579 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.353402 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.353579 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.353432 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz2v2\" (UniqueName: \"kubernetes.io/projected/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-kube-api-access-jz2v2\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.353579 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.353566 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-secret-grpc-tls\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.353775 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.353616 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-secret-thanos-querier-tls\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.353775 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.353664 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-metrics-client-ca\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.353775 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.353703 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.353775 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.353743 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.354622 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.354595 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-metrics-client-ca\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.356632 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.356600 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.356768 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.356716 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-secret-thanos-querier-tls\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.356897 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.356849 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.357379 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.357360 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-secret-grpc-tls\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.357470 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.357362 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.357470 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.357432 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.361981 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.361929 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz2v2\" (UniqueName: \"kubernetes.io/projected/93114ff8-1fc9-48a8-9462-67a0b8bea4f0-kube-api-access-jz2v2\") pod \"thanos-querier-5db95b4bd5-pz54b\" (UID: \"93114ff8-1fc9-48a8-9462-67a0b8bea4f0\") " pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.424440 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.424403 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:54.578555 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.578531 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5db95b4bd5-pz54b"] Jul 22 02:17:54.618653 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:17:54.618562 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93114ff8_1fc9_48a8_9462_67a0b8bea4f0.slice/crio-d3ae3db56f320400d415c2913d2f2ab8d79bf10552ff466860ae8259de938787 WatchSource:0}: Error finding container d3ae3db56f320400d415c2913d2f2ab8d79bf10552ff466860ae8259de938787: Status 404 returned error can't find the container with id d3ae3db56f320400d415c2913d2f2ab8d79bf10552ff466860ae8259de938787 Jul 22 02:17:54.692228 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.692192 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-86mnr" event={"ID":"64c1cf9e-1333-452a-9658-28e622ebccb6","Type":"ContainerStarted","Data":"d51446002e0362978b0263dc2fd248309d9f41712b5ff55e4e2f3c7ebf93aaf4"} Jul 22 02:17:54.692695 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.692253 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-86mnr" event={"ID":"64c1cf9e-1333-452a-9658-28e622ebccb6","Type":"ContainerStarted","Data":"e08386ce85853eeb8891ab663de07faec394eb110ea8606fac325e5a28b37572"} Jul 22 02:17:54.693816 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.693793 2556 generic.go:356] "Generic (PLEG): container finished" podID="36536c18-c4ca-4929-b7fb-f8dea04daf42" containerID="a40b79562ec77a1c832e2df286e39299310a405038c02108113132652ab19253" exitCode=0 Jul 22 02:17:54.693901 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.693878 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36536c18-c4ca-4929-b7fb-f8dea04daf42","Type":"ContainerDied","Data":"a40b79562ec77a1c832e2df286e39299310a405038c02108113132652ab19253"} Jul 22 02:17:54.694994 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.694974 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" event={"ID":"93114ff8-1fc9-48a8-9462-67a0b8bea4f0","Type":"ContainerStarted","Data":"d3ae3db56f320400d415c2913d2f2ab8d79bf10552ff466860ae8259de938787"} Jul 22 02:17:54.711473 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:54.711360 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-86mnr" podStartSLOduration=2.57880846 podStartE2EDuration="3.711340572s" totalImagesPullingTime="1.069445818s" totalInitContainerRuntime="63.086294ms" isStatefulPod=true podCreationTimestamp="2026-07-22 02:17:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:54.711018385 +0000 UTC m=+75.819437753" watchObservedRunningTime="2026-07-22 02:17:54.711340572 +0000 UTC m=+75.819759909" Jul 22 02:17:55.856062 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:55.856034 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:55.860423 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:55.860401 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:17:57.708485 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:57.708443 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" event={"ID":"93114ff8-1fc9-48a8-9462-67a0b8bea4f0","Type":"ContainerStarted","Data":"d96461ad6de6aff8c0805d4fef832dfa7265697524797029342c7bcd8fdbed20"} Jul 22 02:17:57.708888 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:57.708569 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" event={"ID":"93114ff8-1fc9-48a8-9462-67a0b8bea4f0","Type":"ContainerStarted","Data":"2c58ec6f039ae2085f783fa1f95b5e74df6cf1f8a16bf3477e7ba280e30bfbb3"} Jul 22 02:17:57.708888 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:57.708614 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" event={"ID":"93114ff8-1fc9-48a8-9462-67a0b8bea4f0","Type":"ContainerStarted","Data":"d05ebd88f4f64ae2430dd5fc1bfdc96e77e87510d574b2f92f628567eddc4896"} Jul 22 02:17:57.708888 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:57.708670 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" event={"ID":"93114ff8-1fc9-48a8-9462-67a0b8bea4f0","Type":"ContainerStarted","Data":"d31600e0744fd67bf2b2b568369f11ebcc71748baf702c8a441683b98a9512e7"} Jul 22 02:17:57.711570 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:57.711546 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36536c18-c4ca-4929-b7fb-f8dea04daf42","Type":"ContainerStarted","Data":"37e0976a1537090c9a7b57a208a6d5278bd4a0d5325d1510678196d94efe382a"} Jul 22 02:17:57.711709 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:57.711601 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36536c18-c4ca-4929-b7fb-f8dea04daf42","Type":"ContainerStarted","Data":"3139f80544f4c9b72e2e9cc7d35fef460a4ebe856b26d214ce24121cef44ecbb"} Jul 22 02:17:57.711709 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:57.711626 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36536c18-c4ca-4929-b7fb-f8dea04daf42","Type":"ContainerStarted","Data":"dd4508522740a4927a3116f9c754f3573c5278a17e4b0fc3b8b2e490dde8970e"} Jul 22 02:17:57.711709 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:57.711676 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36536c18-c4ca-4929-b7fb-f8dea04daf42","Type":"ContainerStarted","Data":"dbc3950b0c1c3263f4bbc60fdb942458e730fcc9dde6e0a15084fee761b58abe"} Jul 22 02:17:57.711709 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:57.711707 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36536c18-c4ca-4929-b7fb-f8dea04daf42","Type":"ContainerStarted","Data":"695082a672edc4695048d583f4883531c8911e90ae0707c0e2b56b273594d4c9"} Jul 22 02:17:57.711861 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:57.711732 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36536c18-c4ca-4929-b7fb-f8dea04daf42","Type":"ContainerStarted","Data":"faa5a01cbaca89b6eeca8abaacedd1fda7582aa3efa9008d7159b74fb768d926"} Jul 22 02:17:57.760785 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:57.760734 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.928044865 podStartE2EDuration="5.760716432s" totalImagesPullingTime="3.812926982s" totalInitContainerRuntime="19.744585ms" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:57.759762902 +0000 UTC m=+78.868182241" watchObservedRunningTime="2026-07-22 02:17:57.760716432 +0000 UTC m=+78.869135767" Jul 22 02:17:58.718576 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:58.718541 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" event={"ID":"93114ff8-1fc9-48a8-9462-67a0b8bea4f0","Type":"ContainerStarted","Data":"352f496f144b4ce3888f0a0e1d8efb67d648eee2c9ecb38775f167748d93f4bd"} Jul 22 02:17:58.718957 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:58.718613 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" event={"ID":"93114ff8-1fc9-48a8-9462-67a0b8bea4f0","Type":"ContainerStarted","Data":"5abc6d09035de32367f314d152c30b3fcd29842c62dfee69b3961a05bd14f910"} Jul 22 02:17:58.718957 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:58.718929 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:17:58.748567 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:17:58.748516 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" podStartSLOduration=1.959420883 podStartE2EDuration="4.74850091s" totalImagesPullingTime="2.789080027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:58.747568095 +0000 UTC m=+79.855987444" watchObservedRunningTime="2026-07-22 02:17:58.74850091 +0000 UTC m=+79.856920246" Jul 22 02:18:04.727416 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:04.727307 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5db95b4bd5-pz54b" Jul 22 02:18:06.848690 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:06.848654 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bf75bcfbf-h6jgd"] Jul 22 02:18:21.677910 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:21.677874 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-548xn" Jul 22 02:18:31.872892 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:31.872845 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6bf75bcfbf-h6jgd" podUID="d6a2d7be-5e7a-4282-acd6-36f49b9bafa8" containerName="console" containerID="cri-o://b337fb11c5c54d4d9a887f6ba53701e0e2d2b3db01f5516be2d605ba5d93de84" gracePeriod=15 Jul 22 02:18:32.121485 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.121459 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:18:32.245127 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.245094 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-service-ca\") pod \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " Jul 22 02:18:32.245312 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.245151 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffd57\" (UniqueName: \"kubernetes.io/projected/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-kube-api-access-ffd57\") pod \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " Jul 22 02:18:32.245312 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.245175 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-console-config\") pod \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " Jul 22 02:18:32.245312 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.245192 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-oauth-serving-cert\") pod \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " Jul 22 02:18:32.245312 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.245216 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-console-oauth-config\") pod \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " Jul 22 02:18:32.245312 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.245243 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-console-serving-cert\") pod \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\" (UID: \"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8\") " Jul 22 02:18:32.245581 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.245549 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-service-ca" (OuterVolumeSpecName: "service-ca") pod "d6a2d7be-5e7a-4282-acd6-36f49b9bafa8" (UID: "d6a2d7be-5e7a-4282-acd6-36f49b9bafa8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:18:32.245690 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.245664 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d6a2d7be-5e7a-4282-acd6-36f49b9bafa8" (UID: "d6a2d7be-5e7a-4282-acd6-36f49b9bafa8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:18:32.245746 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.245670 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-console-config" (OuterVolumeSpecName: "console-config") pod "d6a2d7be-5e7a-4282-acd6-36f49b9bafa8" (UID: "d6a2d7be-5e7a-4282-acd6-36f49b9bafa8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:18:32.247511 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.247482 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d6a2d7be-5e7a-4282-acd6-36f49b9bafa8" (UID: "d6a2d7be-5e7a-4282-acd6-36f49b9bafa8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:18:32.247607 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.247577 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d6a2d7be-5e7a-4282-acd6-36f49b9bafa8" (UID: "d6a2d7be-5e7a-4282-acd6-36f49b9bafa8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:18:32.247607 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.247587 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-kube-api-access-ffd57" (OuterVolumeSpecName: "kube-api-access-ffd57") pod "d6a2d7be-5e7a-4282-acd6-36f49b9bafa8" (UID: "d6a2d7be-5e7a-4282-acd6-36f49b9bafa8"). InnerVolumeSpecName "kube-api-access-ffd57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:18:32.346748 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.346715 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffd57\" (UniqueName: \"kubernetes.io/projected/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-kube-api-access-ffd57\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:18:32.346748 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.346743 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-console-config\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:18:32.346748 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.346753 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-oauth-serving-cert\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:18:32.346965 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.346762 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-console-oauth-config\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:18:32.346965 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.346771 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-console-serving-cert\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:18:32.346965 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.346779 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8-service-ca\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:18:32.835660 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.835612 2556 generic.go:356] "Generic (PLEG): container finished" podID="d6a2d7be-5e7a-4282-acd6-36f49b9bafa8" containerID="b337fb11c5c54d4d9a887f6ba53701e0e2d2b3db01f5516be2d605ba5d93de84" exitCode=0 Jul 22 02:18:32.835852 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.835672 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bf75bcfbf-h6jgd" Jul 22 02:18:32.835852 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.835689 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bf75bcfbf-h6jgd" event={"ID":"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8","Type":"ContainerDied","Data":"b337fb11c5c54d4d9a887f6ba53701e0e2d2b3db01f5516be2d605ba5d93de84"} Jul 22 02:18:32.835852 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.835731 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bf75bcfbf-h6jgd" event={"ID":"d6a2d7be-5e7a-4282-acd6-36f49b9bafa8","Type":"ContainerDied","Data":"718918d1355fe21c1cbd4a46459528ee55c82a08661253ce5e1e8479e76db49c"} Jul 22 02:18:32.835852 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.835750 2556 scope.go:117] "RemoveContainer" containerID="b337fb11c5c54d4d9a887f6ba53701e0e2d2b3db01f5516be2d605ba5d93de84" Jul 22 02:18:32.843797 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.843779 2556 scope.go:117] "RemoveContainer" containerID="b337fb11c5c54d4d9a887f6ba53701e0e2d2b3db01f5516be2d605ba5d93de84" Jul 22 02:18:32.844044 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:18:32.844022 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b337fb11c5c54d4d9a887f6ba53701e0e2d2b3db01f5516be2d605ba5d93de84\": container with ID starting with b337fb11c5c54d4d9a887f6ba53701e0e2d2b3db01f5516be2d605ba5d93de84 not found: ID does not exist" containerID="b337fb11c5c54d4d9a887f6ba53701e0e2d2b3db01f5516be2d605ba5d93de84" Jul 22 02:18:32.844096 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.844052 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b337fb11c5c54d4d9a887f6ba53701e0e2d2b3db01f5516be2d605ba5d93de84"} err="failed to get container status \"b337fb11c5c54d4d9a887f6ba53701e0e2d2b3db01f5516be2d605ba5d93de84\": rpc error: code = NotFound desc = could not find container \"b337fb11c5c54d4d9a887f6ba53701e0e2d2b3db01f5516be2d605ba5d93de84\": container with ID starting with b337fb11c5c54d4d9a887f6ba53701e0e2d2b3db01f5516be2d605ba5d93de84 not found: ID does not exist" Jul 22 02:18:32.853261 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.853241 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bf75bcfbf-h6jgd"] Jul 22 02:18:32.857239 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:32.857217 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bf75bcfbf-h6jgd"] Jul 22 02:18:34.252661 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:18:34.252615 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6a2d7be-5e7a-4282-acd6-36f49b9bafa8" path="/var/lib/kubelet/pods/d6a2d7be-5e7a-4282-acd6-36f49b9bafa8/volumes" Jul 22 02:19:15.434403 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.434362 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7fb65d574b-pr886"] Jul 22 02:19:15.435039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.434737 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6a2d7be-5e7a-4282-acd6-36f49b9bafa8" containerName="console" Jul 22 02:19:15.435039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.434755 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6a2d7be-5e7a-4282-acd6-36f49b9bafa8" containerName="console" Jul 22 02:19:15.435039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.434837 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6a2d7be-5e7a-4282-acd6-36f49b9bafa8" containerName="console" Jul 22 02:19:15.437780 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.437759 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.441072 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.441034 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 22 02:19:15.441072 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.441049 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 22 02:19:15.441253 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.441111 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 22 02:19:15.441307 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.441269 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 22 02:19:15.441307 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.441269 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rllvh\"" Jul 22 02:19:15.441389 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.441309 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 22 02:19:15.447497 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.447477 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 22 02:19:15.450792 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.450766 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7fb65d574b-pr886"] Jul 22 02:19:15.562666 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.562603 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/688c4876-7068-4755-a76d-0a8d802e5710-federate-client-tls\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.562666 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.562662 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/688c4876-7068-4755-a76d-0a8d802e5710-telemeter-client-tls\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.562881 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.562693 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/688c4876-7068-4755-a76d-0a8d802e5710-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.562881 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.562715 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/688c4876-7068-4755-a76d-0a8d802e5710-secret-telemeter-client\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.562881 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.562757 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfvq6\" (UniqueName: \"kubernetes.io/projected/688c4876-7068-4755-a76d-0a8d802e5710-kube-api-access-mfvq6\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.562881 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.562785 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/688c4876-7068-4755-a76d-0a8d802e5710-metrics-client-ca\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.562881 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.562807 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/688c4876-7068-4755-a76d-0a8d802e5710-serving-certs-ca-bundle\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.562881 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.562835 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/688c4876-7068-4755-a76d-0a8d802e5710-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.663722 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.663670 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfvq6\" (UniqueName: \"kubernetes.io/projected/688c4876-7068-4755-a76d-0a8d802e5710-kube-api-access-mfvq6\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.663908 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.663826 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/688c4876-7068-4755-a76d-0a8d802e5710-metrics-client-ca\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.663908 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.663873 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/688c4876-7068-4755-a76d-0a8d802e5710-serving-certs-ca-bundle\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.664019 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.663923 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/688c4876-7068-4755-a76d-0a8d802e5710-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.664019 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.663964 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/688c4876-7068-4755-a76d-0a8d802e5710-federate-client-tls\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.664019 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.663989 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/688c4876-7068-4755-a76d-0a8d802e5710-telemeter-client-tls\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.664164 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.664019 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/688c4876-7068-4755-a76d-0a8d802e5710-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.664164 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.664064 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/688c4876-7068-4755-a76d-0a8d802e5710-secret-telemeter-client\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.664702 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.664674 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/688c4876-7068-4755-a76d-0a8d802e5710-metrics-client-ca\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.664871 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.664711 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/688c4876-7068-4755-a76d-0a8d802e5710-serving-certs-ca-bundle\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.665000 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.664900 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/688c4876-7068-4755-a76d-0a8d802e5710-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.666466 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.666444 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/688c4876-7068-4755-a76d-0a8d802e5710-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.666677 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.666659 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/688c4876-7068-4755-a76d-0a8d802e5710-telemeter-client-tls\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.666744 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.666714 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/688c4876-7068-4755-a76d-0a8d802e5710-secret-telemeter-client\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.666744 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.666724 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/688c4876-7068-4755-a76d-0a8d802e5710-federate-client-tls\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.672890 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.672866 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfvq6\" (UniqueName: \"kubernetes.io/projected/688c4876-7068-4755-a76d-0a8d802e5710-kube-api-access-mfvq6\") pod \"telemeter-client-7fb65d574b-pr886\" (UID: \"688c4876-7068-4755-a76d-0a8d802e5710\") " pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.747400 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.747322 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" Jul 22 02:19:15.882204 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.882178 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7fb65d574b-pr886"] Jul 22 02:19:15.884811 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:19:15.884784 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod688c4876_7068_4755_a76d_0a8d802e5710.slice/crio-98879d029acf8d12ef562a5f6d7c3719be2485678775a276b94c5e9c3e117e94 WatchSource:0}: Error finding container 98879d029acf8d12ef562a5f6d7c3719be2485678775a276b94c5e9c3e117e94: Status 404 returned error can't find the container with id 98879d029acf8d12ef562a5f6d7c3719be2485678775a276b94c5e9c3e117e94 Jul 22 02:19:15.979096 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:15.979058 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" event={"ID":"688c4876-7068-4755-a76d-0a8d802e5710","Type":"ContainerStarted","Data":"98879d029acf8d12ef562a5f6d7c3719be2485678775a276b94c5e9c3e117e94"} Jul 22 02:19:17.987317 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:17.987279 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" event={"ID":"688c4876-7068-4755-a76d-0a8d802e5710","Type":"ContainerStarted","Data":"2856decc817e5a359c98f6fe9f84cd9ee797a53e0da7ae4e5033f9debf9b63a1"} Jul 22 02:19:17.987761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:17.987339 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" event={"ID":"688c4876-7068-4755-a76d-0a8d802e5710","Type":"ContainerStarted","Data":"49daf8873320bd2db2ce8b0f540b8cfefc24a4e18c422584826e863f86f24737"} Jul 22 02:19:17.987761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:17.987363 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" event={"ID":"688c4876-7068-4755-a76d-0a8d802e5710","Type":"ContainerStarted","Data":"4ec3f61f8ea7fa54f9f4633751ccdce9e3b603d611b267e4922d6f463a07fdc7"} Jul 22 02:19:18.014574 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.014519 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7fb65d574b-pr886" podStartSLOduration=1.242620376 podStartE2EDuration="3.014500086s" totalImagesPullingTime="1.77187971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:19:18.013937733 +0000 UTC m=+159.122357068" watchObservedRunningTime="2026-07-22 02:19:18.014500086 +0000 UTC m=+159.122919421" Jul 22 02:19:18.701715 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.701683 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d87895768-rbkmp"] Jul 22 02:19:18.704745 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.704727 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.707806 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.707785 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 22 02:19:18.709243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.709229 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lmd2l\"" Jul 22 02:19:18.709327 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.709239 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 22 02:19:18.709412 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.709400 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 22 02:19:18.709470 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.709454 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 22 02:19:18.709750 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.709733 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 22 02:19:18.709796 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.709782 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 22 02:19:18.710790 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.710774 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 22 02:19:18.720268 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.718654 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 22 02:19:18.720268 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.718925 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d87895768-rbkmp"] Jul 22 02:19:18.785555 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.785522 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d13e51fd-fbd8-4672-aa8a-d3e068907c14-console-oauth-config\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.785555 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.785565 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-trusted-ca-bundle\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.785834 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.785589 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-oauth-serving-cert\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.785834 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.785630 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-service-ca\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.785834 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.785688 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-console-config\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.785834 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.785745 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d13e51fd-fbd8-4672-aa8a-d3e068907c14-console-serving-cert\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.785834 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.785775 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cp6z\" (UniqueName: \"kubernetes.io/projected/d13e51fd-fbd8-4672-aa8a-d3e068907c14-kube-api-access-6cp6z\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.887055 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.887013 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d13e51fd-fbd8-4672-aa8a-d3e068907c14-console-oauth-config\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.887055 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.887048 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-trusted-ca-bundle\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.887055 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.887065 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-oauth-serving-cert\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.887346 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.887087 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-service-ca\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.887346 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.887116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-console-config\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.887346 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.887165 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d13e51fd-fbd8-4672-aa8a-d3e068907c14-console-serving-cert\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.887346 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.887196 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cp6z\" (UniqueName: \"kubernetes.io/projected/d13e51fd-fbd8-4672-aa8a-d3e068907c14-kube-api-access-6cp6z\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.887980 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.887948 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-oauth-serving-cert\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.888180 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.888153 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-console-config\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.888220 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.888187 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-service-ca\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.888301 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.888282 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-trusted-ca-bundle\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.889552 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.889530 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d13e51fd-fbd8-4672-aa8a-d3e068907c14-console-oauth-config\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.889927 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.889908 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d13e51fd-fbd8-4672-aa8a-d3e068907c14-console-serving-cert\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:18.902398 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:18.902366 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cp6z\" (UniqueName: \"kubernetes.io/projected/d13e51fd-fbd8-4672-aa8a-d3e068907c14-kube-api-access-6cp6z\") pod \"console-d87895768-rbkmp\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:19.014810 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:19.014706 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:19.144683 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:19.144633 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d87895768-rbkmp"] Jul 22 02:19:19.147748 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:19:19.147717 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd13e51fd_fbd8_4672_aa8a_d3e068907c14.slice/crio-0c352b0dc90e2d985993dc36074f8ff9f299ebe6cb0debf818fa9a3f943731f0 WatchSource:0}: Error finding container 0c352b0dc90e2d985993dc36074f8ff9f299ebe6cb0debf818fa9a3f943731f0: Status 404 returned error can't find the container with id 0c352b0dc90e2d985993dc36074f8ff9f299ebe6cb0debf818fa9a3f943731f0 Jul 22 02:19:19.996416 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:19.996380 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d87895768-rbkmp" event={"ID":"d13e51fd-fbd8-4672-aa8a-d3e068907c14","Type":"ContainerStarted","Data":"e1e49654fa101110f3dabce50b7281b4ff088b6c6ff29a49bd5f15befa14ef7e"} Jul 22 02:19:19.996596 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:19.996428 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d87895768-rbkmp" event={"ID":"d13e51fd-fbd8-4672-aa8a-d3e068907c14","Type":"ContainerStarted","Data":"0c352b0dc90e2d985993dc36074f8ff9f299ebe6cb0debf818fa9a3f943731f0"} Jul 22 02:19:20.015384 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:20.015330 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d87895768-rbkmp" podStartSLOduration=2.015316144 podStartE2EDuration="2.015316144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:19:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:19:20.014320872 +0000 UTC m=+161.122740229" watchObservedRunningTime="2026-07-22 02:19:20.015316144 +0000 UTC m=+161.123735538" Jul 22 02:19:27.412371 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.412334 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d87895768-rbkmp"] Jul 22 02:19:27.446444 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.446414 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59cf5ffc87-299gm"] Jul 22 02:19:27.449811 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.449794 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.462140 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.462118 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59cf5ffc87-299gm"] Jul 22 02:19:27.558894 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.558856 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zspp\" (UniqueName: \"kubernetes.io/projected/4478784f-fe2d-4b2e-8679-acd857188038-kube-api-access-5zspp\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.558894 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.558897 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-trusted-ca-bundle\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.559145 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.558920 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-service-ca\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.559145 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.558967 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-oauth-serving-cert\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.559145 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.559092 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4478784f-fe2d-4b2e-8679-acd857188038-console-serving-cert\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.559304 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.559195 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-console-config\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.559304 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.559235 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4478784f-fe2d-4b2e-8679-acd857188038-console-oauth-config\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.660190 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.660156 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-console-config\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.660340 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.660197 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4478784f-fe2d-4b2e-8679-acd857188038-console-oauth-config\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.660340 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.660224 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zspp\" (UniqueName: \"kubernetes.io/projected/4478784f-fe2d-4b2e-8679-acd857188038-kube-api-access-5zspp\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.660340 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.660245 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-trusted-ca-bundle\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.660340 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.660270 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-service-ca\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.660340 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.660293 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-oauth-serving-cert\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.660340 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.660321 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4478784f-fe2d-4b2e-8679-acd857188038-console-serving-cert\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.661222 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.661191 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-oauth-serving-cert\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.661353 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.661222 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-service-ca\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.661353 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.661204 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-console-config\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.661353 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.661300 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-trusted-ca-bundle\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.662748 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.662691 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4478784f-fe2d-4b2e-8679-acd857188038-console-oauth-config\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.662838 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.662784 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4478784f-fe2d-4b2e-8679-acd857188038-console-serving-cert\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.668904 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.668887 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zspp\" (UniqueName: \"kubernetes.io/projected/4478784f-fe2d-4b2e-8679-acd857188038-kube-api-access-5zspp\") pod \"console-59cf5ffc87-299gm\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.758505 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.758465 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:27.883484 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:27.883454 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59cf5ffc87-299gm"] Jul 22 02:19:27.886652 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:19:27.886616 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4478784f_fe2d_4b2e_8679_acd857188038.slice/crio-3e9c847c58014781372a441fd0ceec9d1a40d537dda5086e80ce12e1f93d0d13 WatchSource:0}: Error finding container 3e9c847c58014781372a441fd0ceec9d1a40d537dda5086e80ce12e1f93d0d13: Status 404 returned error can't find the container with id 3e9c847c58014781372a441fd0ceec9d1a40d537dda5086e80ce12e1f93d0d13 Jul 22 02:19:28.026547 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:28.026513 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cf5ffc87-299gm" event={"ID":"4478784f-fe2d-4b2e-8679-acd857188038","Type":"ContainerStarted","Data":"8c29735ba8779b5e27448d029a51fbc6d5be2750f3ee38cdbab04f51806b3c5d"} Jul 22 02:19:28.026716 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:28.026565 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cf5ffc87-299gm" event={"ID":"4478784f-fe2d-4b2e-8679-acd857188038","Type":"ContainerStarted","Data":"3e9c847c58014781372a441fd0ceec9d1a40d537dda5086e80ce12e1f93d0d13"} Jul 22 02:19:28.043780 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:28.043731 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59cf5ffc87-299gm" podStartSLOduration=1.04371467 podStartE2EDuration="1.04371467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:19:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:19:28.043159584 +0000 UTC m=+169.151578943" watchObservedRunningTime="2026-07-22 02:19:28.04371467 +0000 UTC m=+169.152134005" Jul 22 02:19:29.015038 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:29.015000 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:37.759550 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:37.759460 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:37.759550 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:37.759518 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:37.764331 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:37.764310 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:38.071442 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:38.071362 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:19:52.431794 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.431726 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d87895768-rbkmp" podUID="d13e51fd-fbd8-4672-aa8a-d3e068907c14" containerName="console" containerID="cri-o://e1e49654fa101110f3dabce50b7281b4ff088b6c6ff29a49bd5f15befa14ef7e" gracePeriod=15 Jul 22 02:19:52.673607 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.673583 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:52.762066 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.761978 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cp6z\" (UniqueName: \"kubernetes.io/projected/d13e51fd-fbd8-4672-aa8a-d3e068907c14-kube-api-access-6cp6z\") pod \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " Jul 22 02:19:52.762066 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.762028 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d13e51fd-fbd8-4672-aa8a-d3e068907c14-console-oauth-config\") pod \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " Jul 22 02:19:52.762066 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.762049 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-trusted-ca-bundle\") pod \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " Jul 22 02:19:52.762311 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.762075 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-service-ca\") pod \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " Jul 22 02:19:52.762311 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.762134 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d13e51fd-fbd8-4672-aa8a-d3e068907c14-console-serving-cert\") pod \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " Jul 22 02:19:52.762311 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.762162 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-console-config\") pod \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " Jul 22 02:19:52.762311 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.762186 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-oauth-serving-cert\") pod \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\" (UID: \"d13e51fd-fbd8-4672-aa8a-d3e068907c14\") " Jul 22 02:19:52.762622 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.762576 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d13e51fd-fbd8-4672-aa8a-d3e068907c14" (UID: "d13e51fd-fbd8-4672-aa8a-d3e068907c14"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:19:52.762622 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.762589 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-service-ca" (OuterVolumeSpecName: "service-ca") pod "d13e51fd-fbd8-4672-aa8a-d3e068907c14" (UID: "d13e51fd-fbd8-4672-aa8a-d3e068907c14"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:19:52.762792 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.762618 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-console-config" (OuterVolumeSpecName: "console-config") pod "d13e51fd-fbd8-4672-aa8a-d3e068907c14" (UID: "d13e51fd-fbd8-4672-aa8a-d3e068907c14"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:19:52.762792 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.762668 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d13e51fd-fbd8-4672-aa8a-d3e068907c14" (UID: "d13e51fd-fbd8-4672-aa8a-d3e068907c14"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:19:52.764159 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.764137 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d13e51fd-fbd8-4672-aa8a-d3e068907c14-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d13e51fd-fbd8-4672-aa8a-d3e068907c14" (UID: "d13e51fd-fbd8-4672-aa8a-d3e068907c14"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:19:52.764306 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.764286 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d13e51fd-fbd8-4672-aa8a-d3e068907c14-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d13e51fd-fbd8-4672-aa8a-d3e068907c14" (UID: "d13e51fd-fbd8-4672-aa8a-d3e068907c14"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:19:52.764410 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.764386 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d13e51fd-fbd8-4672-aa8a-d3e068907c14-kube-api-access-6cp6z" (OuterVolumeSpecName: "kube-api-access-6cp6z") pod "d13e51fd-fbd8-4672-aa8a-d3e068907c14" (UID: "d13e51fd-fbd8-4672-aa8a-d3e068907c14"). InnerVolumeSpecName "kube-api-access-6cp6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:19:52.863516 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.863481 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-oauth-serving-cert\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:19:52.863516 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.863514 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cp6z\" (UniqueName: \"kubernetes.io/projected/d13e51fd-fbd8-4672-aa8a-d3e068907c14-kube-api-access-6cp6z\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:19:52.863516 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.863524 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d13e51fd-fbd8-4672-aa8a-d3e068907c14-console-oauth-config\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:19:52.863759 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.863533 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-trusted-ca-bundle\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:19:52.863759 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.863541 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-service-ca\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:19:52.863759 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.863550 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d13e51fd-fbd8-4672-aa8a-d3e068907c14-console-serving-cert\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:19:52.863759 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:52.863558 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d13e51fd-fbd8-4672-aa8a-d3e068907c14-console-config\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:19:53.118614 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:53.118531 2556 generic.go:356] "Generic (PLEG): container finished" podID="d13e51fd-fbd8-4672-aa8a-d3e068907c14" containerID="e1e49654fa101110f3dabce50b7281b4ff088b6c6ff29a49bd5f15befa14ef7e" exitCode=0 Jul 22 02:19:53.118614 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:53.118587 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d87895768-rbkmp" Jul 22 02:19:53.118614 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:53.118596 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d87895768-rbkmp" event={"ID":"d13e51fd-fbd8-4672-aa8a-d3e068907c14","Type":"ContainerDied","Data":"e1e49654fa101110f3dabce50b7281b4ff088b6c6ff29a49bd5f15befa14ef7e"} Jul 22 02:19:53.118856 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:53.118668 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d87895768-rbkmp" event={"ID":"d13e51fd-fbd8-4672-aa8a-d3e068907c14","Type":"ContainerDied","Data":"0c352b0dc90e2d985993dc36074f8ff9f299ebe6cb0debf818fa9a3f943731f0"} Jul 22 02:19:53.118856 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:53.118698 2556 scope.go:117] "RemoveContainer" containerID="e1e49654fa101110f3dabce50b7281b4ff088b6c6ff29a49bd5f15befa14ef7e" Jul 22 02:19:53.126915 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:53.126896 2556 scope.go:117] "RemoveContainer" containerID="e1e49654fa101110f3dabce50b7281b4ff088b6c6ff29a49bd5f15befa14ef7e" Jul 22 02:19:53.127161 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:19:53.127140 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1e49654fa101110f3dabce50b7281b4ff088b6c6ff29a49bd5f15befa14ef7e\": container with ID starting with e1e49654fa101110f3dabce50b7281b4ff088b6c6ff29a49bd5f15befa14ef7e not found: ID does not exist" containerID="e1e49654fa101110f3dabce50b7281b4ff088b6c6ff29a49bd5f15befa14ef7e" Jul 22 02:19:53.127228 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:53.127174 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1e49654fa101110f3dabce50b7281b4ff088b6c6ff29a49bd5f15befa14ef7e"} err="failed to get container status \"e1e49654fa101110f3dabce50b7281b4ff088b6c6ff29a49bd5f15befa14ef7e\": rpc error: code = NotFound desc = could not find container \"e1e49654fa101110f3dabce50b7281b4ff088b6c6ff29a49bd5f15befa14ef7e\": container with ID starting with e1e49654fa101110f3dabce50b7281b4ff088b6c6ff29a49bd5f15befa14ef7e not found: ID does not exist" Jul 22 02:19:53.139194 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:53.139171 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d87895768-rbkmp"] Jul 22 02:19:53.143471 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:53.143445 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d87895768-rbkmp"] Jul 22 02:19:54.252976 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:19:54.252946 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d13e51fd-fbd8-4672-aa8a-d3e068907c14" path="/var/lib/kubelet/pods/d13e51fd-fbd8-4672-aa8a-d3e068907c14/volumes" Jul 22 02:20:28.011211 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:28.011175 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7"] Jul 22 02:20:28.011663 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:28.011450 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d13e51fd-fbd8-4672-aa8a-d3e068907c14" containerName="console" Jul 22 02:20:28.011663 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:28.011461 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d13e51fd-fbd8-4672-aa8a-d3e068907c14" containerName="console" Jul 22 02:20:28.011663 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:28.011516 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d13e51fd-fbd8-4672-aa8a-d3e068907c14" containerName="console" Jul 22 02:20:28.014747 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:28.014729 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7" Jul 22 02:20:28.017918 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:28.017898 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 02:20:28.017994 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:28.017953 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 02:20:28.019350 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:28.019333 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cph76\"" Jul 22 02:20:28.023006 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:28.022983 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7"] Jul 22 02:20:28.133660 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:28.133583 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0710240-fcfc-4767-81a5-6e0eae1f002f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7\" (UID: \"e0710240-fcfc-4767-81a5-6e0eae1f002f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7" Jul 22 02:20:28.133845 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:28.133720 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0710240-fcfc-4767-81a5-6e0eae1f002f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7\" (UID: \"e0710240-fcfc-4767-81a5-6e0eae1f002f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7" Jul 22 02:20:28.133845 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:28.133753 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gpgf\" (UniqueName: \"kubernetes.io/projected/e0710240-fcfc-4767-81a5-6e0eae1f002f-kube-api-access-5gpgf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7\" (UID: \"e0710240-fcfc-4767-81a5-6e0eae1f002f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7" Jul 22 02:20:28.234585 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:28.234545 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0710240-fcfc-4767-81a5-6e0eae1f002f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7\" (UID: \"e0710240-fcfc-4767-81a5-6e0eae1f002f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7" Jul 22 02:20:28.234585 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:28.234587 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gpgf\" (UniqueName: \"kubernetes.io/projected/e0710240-fcfc-4767-81a5-6e0eae1f002f-kube-api-access-5gpgf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7\" (UID: \"e0710240-fcfc-4767-81a5-6e0eae1f002f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7" Jul 22 02:20:28.234800 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:28.234627 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0710240-fcfc-4767-81a5-6e0eae1f002f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7\" (UID: \"e0710240-fcfc-4767-81a5-6e0eae1f002f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7" Jul 22 02:20:28.234958 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:28.234938 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0710240-fcfc-4767-81a5-6e0eae1f002f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7\" (UID: \"e0710240-fcfc-4767-81a5-6e0eae1f002f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7" Jul 22 02:20:28.235062 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:28.235042 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0710240-fcfc-4767-81a5-6e0eae1f002f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7\" (UID: \"e0710240-fcfc-4767-81a5-6e0eae1f002f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7" Jul 22 02:20:28.243931 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:28.243901 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gpgf\" (UniqueName: \"kubernetes.io/projected/e0710240-fcfc-4767-81a5-6e0eae1f002f-kube-api-access-5gpgf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7\" (UID: \"e0710240-fcfc-4767-81a5-6e0eae1f002f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7" Jul 22 02:20:28.323694 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:28.323571 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7" Jul 22 02:20:28.453373 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:28.453345 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7"] Jul 22 02:20:28.455937 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:20:28.455904 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0710240_fcfc_4767_81a5_6e0eae1f002f.slice/crio-16269e3796c2dc3e3d1f09102a1645976e85d0fccb5769d694fbab7ab2ccaad2 WatchSource:0}: Error finding container 16269e3796c2dc3e3d1f09102a1645976e85d0fccb5769d694fbab7ab2ccaad2: Status 404 returned error can't find the container with id 16269e3796c2dc3e3d1f09102a1645976e85d0fccb5769d694fbab7ab2ccaad2 Jul 22 02:20:29.247989 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:29.247950 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7" event={"ID":"e0710240-fcfc-4767-81a5-6e0eae1f002f","Type":"ContainerStarted","Data":"16269e3796c2dc3e3d1f09102a1645976e85d0fccb5769d694fbab7ab2ccaad2"} Jul 22 02:20:36.274900 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:36.274866 2556 generic.go:356] "Generic (PLEG): container finished" podID="e0710240-fcfc-4767-81a5-6e0eae1f002f" containerID="17918263df287b23f9ce727cedbebbcec95db3167beaf41d8024be4c4ab82e1e" exitCode=0 Jul 22 02:20:36.275277 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:36.274929 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7" event={"ID":"e0710240-fcfc-4767-81a5-6e0eae1f002f","Type":"ContainerDied","Data":"17918263df287b23f9ce727cedbebbcec95db3167beaf41d8024be4c4ab82e1e"} Jul 22 02:20:39.287362 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:39.287330 2556 generic.go:356] "Generic (PLEG): container finished" podID="e0710240-fcfc-4767-81a5-6e0eae1f002f" containerID="c9eed673fcd706370c154b24dadc5e75a887fde863c8850ac77757e564d351c0" exitCode=0 Jul 22 02:20:39.287756 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:39.287416 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7" event={"ID":"e0710240-fcfc-4767-81a5-6e0eae1f002f","Type":"ContainerDied","Data":"c9eed673fcd706370c154b24dadc5e75a887fde863c8850ac77757e564d351c0"} Jul 22 02:20:47.318448 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:47.318407 2556 generic.go:356] "Generic (PLEG): container finished" podID="e0710240-fcfc-4767-81a5-6e0eae1f002f" containerID="890a55b1aa7bae0963082a61282b0876d264d67102fcd18d75bc7bdbaf329a9c" exitCode=0 Jul 22 02:20:47.318917 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:47.318484 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7" event={"ID":"e0710240-fcfc-4767-81a5-6e0eae1f002f","Type":"ContainerDied","Data":"890a55b1aa7bae0963082a61282b0876d264d67102fcd18d75bc7bdbaf329a9c"} Jul 22 02:20:48.444097 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:48.444074 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7" Jul 22 02:20:48.618761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:48.618669 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0710240-fcfc-4767-81a5-6e0eae1f002f-util\") pod \"e0710240-fcfc-4767-81a5-6e0eae1f002f\" (UID: \"e0710240-fcfc-4767-81a5-6e0eae1f002f\") " Jul 22 02:20:48.618761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:48.618749 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0710240-fcfc-4767-81a5-6e0eae1f002f-bundle\") pod \"e0710240-fcfc-4767-81a5-6e0eae1f002f\" (UID: \"e0710240-fcfc-4767-81a5-6e0eae1f002f\") " Jul 22 02:20:48.618984 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:48.618782 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gpgf\" (UniqueName: \"kubernetes.io/projected/e0710240-fcfc-4767-81a5-6e0eae1f002f-kube-api-access-5gpgf\") pod \"e0710240-fcfc-4767-81a5-6e0eae1f002f\" (UID: \"e0710240-fcfc-4767-81a5-6e0eae1f002f\") " Jul 22 02:20:48.619505 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:48.619476 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0710240-fcfc-4767-81a5-6e0eae1f002f-bundle" (OuterVolumeSpecName: "bundle") pod "e0710240-fcfc-4767-81a5-6e0eae1f002f" (UID: "e0710240-fcfc-4767-81a5-6e0eae1f002f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:20:48.621076 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:48.621050 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0710240-fcfc-4767-81a5-6e0eae1f002f-kube-api-access-5gpgf" (OuterVolumeSpecName: "kube-api-access-5gpgf") pod "e0710240-fcfc-4767-81a5-6e0eae1f002f" (UID: "e0710240-fcfc-4767-81a5-6e0eae1f002f"). InnerVolumeSpecName "kube-api-access-5gpgf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:20:48.624180 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:48.624157 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0710240-fcfc-4767-81a5-6e0eae1f002f-util" (OuterVolumeSpecName: "util") pod "e0710240-fcfc-4767-81a5-6e0eae1f002f" (UID: "e0710240-fcfc-4767-81a5-6e0eae1f002f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:20:48.720294 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:48.720259 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gpgf\" (UniqueName: \"kubernetes.io/projected/e0710240-fcfc-4767-81a5-6e0eae1f002f-kube-api-access-5gpgf\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:20:48.720294 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:48.720288 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0710240-fcfc-4767-81a5-6e0eae1f002f-util\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:20:48.720294 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:48.720297 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0710240-fcfc-4767-81a5-6e0eae1f002f-bundle\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:20:49.327841 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:49.327808 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7" event={"ID":"e0710240-fcfc-4767-81a5-6e0eae1f002f","Type":"ContainerDied","Data":"16269e3796c2dc3e3d1f09102a1645976e85d0fccb5769d694fbab7ab2ccaad2"} Jul 22 02:20:49.328006 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:49.327853 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16269e3796c2dc3e3d1f09102a1645976e85d0fccb5769d694fbab7ab2ccaad2" Jul 22 02:20:49.328006 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:49.327853 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406q4t7" Jul 22 02:20:56.064280 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.064246 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wh2f"] Jul 22 02:20:56.064743 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.064543 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0710240-fcfc-4767-81a5-6e0eae1f002f" containerName="util" Jul 22 02:20:56.064743 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.064557 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0710240-fcfc-4767-81a5-6e0eae1f002f" containerName="util" Jul 22 02:20:56.064743 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.064564 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0710240-fcfc-4767-81a5-6e0eae1f002f" containerName="extract" Jul 22 02:20:56.064743 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.064570 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0710240-fcfc-4767-81a5-6e0eae1f002f" containerName="extract" Jul 22 02:20:56.064743 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.064582 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0710240-fcfc-4767-81a5-6e0eae1f002f" containerName="pull" Jul 22 02:20:56.064743 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.064588 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0710240-fcfc-4767-81a5-6e0eae1f002f" containerName="pull" Jul 22 02:20:56.064743 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.064651 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0710240-fcfc-4767-81a5-6e0eae1f002f" containerName="extract" Jul 22 02:20:56.068078 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.068059 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wh2f" Jul 22 02:20:56.070513 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.070491 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7srs\" (UniqueName: \"kubernetes.io/projected/1fcc61c0-0407-4e5e-8e01-edd27b4132ce-kube-api-access-b7srs\") pod \"cert-manager-operator-controller-manager-55c444bf86-9wh2f\" (UID: \"1fcc61c0-0407-4e5e-8e01-edd27b4132ce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wh2f" Jul 22 02:20:56.070591 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.070530 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fcc61c0-0407-4e5e-8e01-edd27b4132ce-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9wh2f\" (UID: \"1fcc61c0-0407-4e5e-8e01-edd27b4132ce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wh2f" Jul 22 02:20:56.071504 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.071488 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-88tg7\"" Jul 22 02:20:56.071734 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.071722 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 22 02:20:56.072230 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.072210 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 22 02:20:56.091403 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.091378 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wh2f"] Jul 22 02:20:56.171072 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.171035 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7srs\" (UniqueName: \"kubernetes.io/projected/1fcc61c0-0407-4e5e-8e01-edd27b4132ce-kube-api-access-b7srs\") pod \"cert-manager-operator-controller-manager-55c444bf86-9wh2f\" (UID: \"1fcc61c0-0407-4e5e-8e01-edd27b4132ce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wh2f" Jul 22 02:20:56.171245 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.171085 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fcc61c0-0407-4e5e-8e01-edd27b4132ce-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9wh2f\" (UID: \"1fcc61c0-0407-4e5e-8e01-edd27b4132ce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wh2f" Jul 22 02:20:56.171510 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.171492 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fcc61c0-0407-4e5e-8e01-edd27b4132ce-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9wh2f\" (UID: \"1fcc61c0-0407-4e5e-8e01-edd27b4132ce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wh2f" Jul 22 02:20:56.180004 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.179985 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7srs\" (UniqueName: \"kubernetes.io/projected/1fcc61c0-0407-4e5e-8e01-edd27b4132ce-kube-api-access-b7srs\") pod \"cert-manager-operator-controller-manager-55c444bf86-9wh2f\" (UID: \"1fcc61c0-0407-4e5e-8e01-edd27b4132ce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wh2f" Jul 22 02:20:56.377350 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.377270 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wh2f" Jul 22 02:20:56.508729 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:56.508698 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wh2f"] Jul 22 02:20:56.513100 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:20:56.513071 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fcc61c0_0407_4e5e_8e01_edd27b4132ce.slice/crio-3ca9ac2628988a7f5a6d8f278ffbe2d8f7b050a7143cd1ed0253e617ab6eabe4 WatchSource:0}: Error finding container 3ca9ac2628988a7f5a6d8f278ffbe2d8f7b050a7143cd1ed0253e617ab6eabe4: Status 404 returned error can't find the container with id 3ca9ac2628988a7f5a6d8f278ffbe2d8f7b050a7143cd1ed0253e617ab6eabe4 Jul 22 02:20:57.354913 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:57.354872 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wh2f" event={"ID":"1fcc61c0-0407-4e5e-8e01-edd27b4132ce","Type":"ContainerStarted","Data":"3ca9ac2628988a7f5a6d8f278ffbe2d8f7b050a7143cd1ed0253e617ab6eabe4"} Jul 22 02:20:59.365282 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:59.365243 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wh2f" event={"ID":"1fcc61c0-0407-4e5e-8e01-edd27b4132ce","Type":"ContainerStarted","Data":"2c1be29bec8249f153b3c768ad4d7642fb7d7fe28c683de56a56b4923cda06cf"} Jul 22 02:20:59.389328 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:20:59.389270 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wh2f" podStartSLOduration=0.656921719 podStartE2EDuration="3.389249804s" totalImagesPullingTime="2.732328085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:20:59.388935841 +0000 UTC m=+260.497355200" watchObservedRunningTime="2026-07-22 02:20:59.389249804 +0000 UTC m=+260.497669146" Jul 22 02:21:00.105019 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:00.104985 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z"] Jul 22 02:21:00.107321 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:00.107304 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z" Jul 22 02:21:00.110452 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:00.110427 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cph76\"" Jul 22 02:21:00.110560 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:00.110472 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 02:21:00.111556 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:00.111540 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 02:21:00.118836 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:00.118812 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z"] Jul 22 02:21:00.195855 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:00.195823 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwpgl\" (UniqueName: \"kubernetes.io/projected/0dd21618-79d8-46fe-9cc9-d803bfc40d3f-kube-api-access-lwpgl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z\" (UID: \"0dd21618-79d8-46fe-9cc9-d803bfc40d3f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z" Jul 22 02:21:00.196022 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:00.195892 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dd21618-79d8-46fe-9cc9-d803bfc40d3f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z\" (UID: \"0dd21618-79d8-46fe-9cc9-d803bfc40d3f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z" Jul 22 02:21:00.196022 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:00.195936 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dd21618-79d8-46fe-9cc9-d803bfc40d3f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z\" (UID: \"0dd21618-79d8-46fe-9cc9-d803bfc40d3f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z" Jul 22 02:21:00.297049 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:00.297012 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dd21618-79d8-46fe-9cc9-d803bfc40d3f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z\" (UID: \"0dd21618-79d8-46fe-9cc9-d803bfc40d3f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z" Jul 22 02:21:00.297207 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:00.297056 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dd21618-79d8-46fe-9cc9-d803bfc40d3f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z\" (UID: \"0dd21618-79d8-46fe-9cc9-d803bfc40d3f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z" Jul 22 02:21:00.297207 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:00.297100 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwpgl\" (UniqueName: \"kubernetes.io/projected/0dd21618-79d8-46fe-9cc9-d803bfc40d3f-kube-api-access-lwpgl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z\" (UID: \"0dd21618-79d8-46fe-9cc9-d803bfc40d3f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z" Jul 22 02:21:00.297405 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:00.297387 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dd21618-79d8-46fe-9cc9-d803bfc40d3f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z\" (UID: \"0dd21618-79d8-46fe-9cc9-d803bfc40d3f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z" Jul 22 02:21:00.297443 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:00.297417 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dd21618-79d8-46fe-9cc9-d803bfc40d3f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z\" (UID: \"0dd21618-79d8-46fe-9cc9-d803bfc40d3f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z" Jul 22 02:21:00.314401 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:00.314369 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwpgl\" (UniqueName: \"kubernetes.io/projected/0dd21618-79d8-46fe-9cc9-d803bfc40d3f-kube-api-access-lwpgl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z\" (UID: \"0dd21618-79d8-46fe-9cc9-d803bfc40d3f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z" Jul 22 02:21:00.416849 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:00.416816 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z" Jul 22 02:21:00.549509 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:00.549483 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z"] Jul 22 02:21:00.552151 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:21:00.552119 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd21618_79d8_46fe_9cc9_d803bfc40d3f.slice/crio-6f027136b9a76d1708de2127e0519136ef3163b6fd79f9bbed1d68e473ffa860 WatchSource:0}: Error finding container 6f027136b9a76d1708de2127e0519136ef3163b6fd79f9bbed1d68e473ffa860: Status 404 returned error can't find the container with id 6f027136b9a76d1708de2127e0519136ef3163b6fd79f9bbed1d68e473ffa860 Jul 22 02:21:01.375273 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:01.375242 2556 generic.go:356] "Generic (PLEG): container finished" podID="0dd21618-79d8-46fe-9cc9-d803bfc40d3f" containerID="241181f7094ad44dda2a09efc86e80feb36151b47bb7a8809bc3d15ea73d93d1" exitCode=0 Jul 22 02:21:01.375421 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:01.375305 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z" event={"ID":"0dd21618-79d8-46fe-9cc9-d803bfc40d3f","Type":"ContainerDied","Data":"241181f7094ad44dda2a09efc86e80feb36151b47bb7a8809bc3d15ea73d93d1"} Jul 22 02:21:01.375421 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:01.375347 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z" event={"ID":"0dd21618-79d8-46fe-9cc9-d803bfc40d3f","Type":"ContainerStarted","Data":"6f027136b9a76d1708de2127e0519136ef3163b6fd79f9bbed1d68e473ffa860"} Jul 22 02:21:01.378841 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:01.378819 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jg2vf"] Jul 22 02:21:01.380870 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:01.380853 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-jg2vf" Jul 22 02:21:01.383896 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:01.383874 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 22 02:21:01.383896 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:01.383891 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-gwk45\"" Jul 22 02:21:01.384036 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:01.383908 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 22 02:21:01.390900 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:01.390874 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jg2vf"] Jul 22 02:21:01.405156 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:01.405116 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82kc9\" (UniqueName: \"kubernetes.io/projected/f01c2944-7d60-4912-9a5e-5857738c2e01-kube-api-access-82kc9\") pod \"cert-manager-webhook-6486ffd997-jg2vf\" (UID: \"f01c2944-7d60-4912-9a5e-5857738c2e01\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jg2vf" Jul 22 02:21:01.405318 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:01.405190 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f01c2944-7d60-4912-9a5e-5857738c2e01-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jg2vf\" (UID: \"f01c2944-7d60-4912-9a5e-5857738c2e01\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jg2vf" Jul 22 02:21:01.506379 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:01.506340 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82kc9\" (UniqueName: \"kubernetes.io/projected/f01c2944-7d60-4912-9a5e-5857738c2e01-kube-api-access-82kc9\") pod \"cert-manager-webhook-6486ffd997-jg2vf\" (UID: \"f01c2944-7d60-4912-9a5e-5857738c2e01\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jg2vf" Jul 22 02:21:01.506819 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:01.506418 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f01c2944-7d60-4912-9a5e-5857738c2e01-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jg2vf\" (UID: \"f01c2944-7d60-4912-9a5e-5857738c2e01\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jg2vf" Jul 22 02:21:01.514804 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:01.514768 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f01c2944-7d60-4912-9a5e-5857738c2e01-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jg2vf\" (UID: \"f01c2944-7d60-4912-9a5e-5857738c2e01\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jg2vf" Jul 22 02:21:01.515050 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:01.515030 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82kc9\" (UniqueName: \"kubernetes.io/projected/f01c2944-7d60-4912-9a5e-5857738c2e01-kube-api-access-82kc9\") pod \"cert-manager-webhook-6486ffd997-jg2vf\" (UID: \"f01c2944-7d60-4912-9a5e-5857738c2e01\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jg2vf" Jul 22 02:21:01.699092 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:01.699054 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-jg2vf" Jul 22 02:21:01.827437 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:01.827408 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jg2vf"] Jul 22 02:21:01.829499 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:21:01.829469 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf01c2944_7d60_4912_9a5e_5857738c2e01.slice/crio-a5de6f519b7c8b1d9695cd297867f3a7a9b2c20b9766a36b258a20c63b49993a WatchSource:0}: Error finding container a5de6f519b7c8b1d9695cd297867f3a7a9b2c20b9766a36b258a20c63b49993a: Status 404 returned error can't find the container with id a5de6f519b7c8b1d9695cd297867f3a7a9b2c20b9766a36b258a20c63b49993a Jul 22 02:21:02.380371 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:02.380332 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-jg2vf" event={"ID":"f01c2944-7d60-4912-9a5e-5857738c2e01","Type":"ContainerStarted","Data":"a5de6f519b7c8b1d9695cd297867f3a7a9b2c20b9766a36b258a20c63b49993a"} Jul 22 02:21:06.400368 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:06.400333 2556 generic.go:356] "Generic (PLEG): container finished" podID="0dd21618-79d8-46fe-9cc9-d803bfc40d3f" containerID="cfb448d7e3b519be45d99d18da85c9c611d5bf91c65e511ba460514a61ec4cad" exitCode=0 Jul 22 02:21:06.400855 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:06.400408 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z" event={"ID":"0dd21618-79d8-46fe-9cc9-d803bfc40d3f","Type":"ContainerDied","Data":"cfb448d7e3b519be45d99d18da85c9c611d5bf91c65e511ba460514a61ec4cad"} Jul 22 02:21:06.401865 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:06.401830 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-jg2vf" event={"ID":"f01c2944-7d60-4912-9a5e-5857738c2e01","Type":"ContainerStarted","Data":"8880788cc7dc231e58d176436ec30793ff8c6dc2cff456478467cba75ddbb524"} Jul 22 02:21:06.401978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:06.401963 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-jg2vf" Jul 22 02:21:06.437512 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:06.437461 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-jg2vf" podStartSLOduration=1.654883882 podStartE2EDuration="5.437443314s" totalImagesPullingTime="3.782559432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:21:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:21:06.436244604 +0000 UTC m=+267.544663941" watchObservedRunningTime="2026-07-22 02:21:06.437443314 +0000 UTC m=+267.545862651" Jul 22 02:21:07.408044 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:07.408010 2556 generic.go:356] "Generic (PLEG): container finished" podID="0dd21618-79d8-46fe-9cc9-d803bfc40d3f" containerID="6f22f7ef9ddabb8e29e40035fe38b4c3bb822ac387af102da8505ef2cb7dfd54" exitCode=0 Jul 22 02:21:07.408421 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:07.408102 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z" event={"ID":"0dd21618-79d8-46fe-9cc9-d803bfc40d3f","Type":"ContainerDied","Data":"6f22f7ef9ddabb8e29e40035fe38b4c3bb822ac387af102da8505ef2cb7dfd54"} Jul 22 02:21:08.542758 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.542734 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z" Jul 22 02:21:08.568392 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.568359 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dd21618-79d8-46fe-9cc9-d803bfc40d3f-util\") pod \"0dd21618-79d8-46fe-9cc9-d803bfc40d3f\" (UID: \"0dd21618-79d8-46fe-9cc9-d803bfc40d3f\") " Jul 22 02:21:08.568542 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.568410 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dd21618-79d8-46fe-9cc9-d803bfc40d3f-bundle\") pod \"0dd21618-79d8-46fe-9cc9-d803bfc40d3f\" (UID: \"0dd21618-79d8-46fe-9cc9-d803bfc40d3f\") " Jul 22 02:21:08.568542 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.568500 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwpgl\" (UniqueName: \"kubernetes.io/projected/0dd21618-79d8-46fe-9cc9-d803bfc40d3f-kube-api-access-lwpgl\") pod \"0dd21618-79d8-46fe-9cc9-d803bfc40d3f\" (UID: \"0dd21618-79d8-46fe-9cc9-d803bfc40d3f\") " Jul 22 02:21:08.568942 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.568912 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd21618-79d8-46fe-9cc9-d803bfc40d3f-bundle" (OuterVolumeSpecName: "bundle") pod "0dd21618-79d8-46fe-9cc9-d803bfc40d3f" (UID: "0dd21618-79d8-46fe-9cc9-d803bfc40d3f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:21:08.570580 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.570558 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dd21618-79d8-46fe-9cc9-d803bfc40d3f-kube-api-access-lwpgl" (OuterVolumeSpecName: "kube-api-access-lwpgl") pod "0dd21618-79d8-46fe-9cc9-d803bfc40d3f" (UID: "0dd21618-79d8-46fe-9cc9-d803bfc40d3f"). InnerVolumeSpecName "kube-api-access-lwpgl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:21:08.572796 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.572769 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd21618-79d8-46fe-9cc9-d803bfc40d3f-util" (OuterVolumeSpecName: "util") pod "0dd21618-79d8-46fe-9cc9-d803bfc40d3f" (UID: "0dd21618-79d8-46fe-9cc9-d803bfc40d3f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:21:08.587635 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.587605 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-89np7"] Jul 22 02:21:08.587923 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.587909 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dd21618-79d8-46fe-9cc9-d803bfc40d3f" containerName="util" Jul 22 02:21:08.587969 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.587925 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dd21618-79d8-46fe-9cc9-d803bfc40d3f" containerName="util" Jul 22 02:21:08.587969 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.587940 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dd21618-79d8-46fe-9cc9-d803bfc40d3f" containerName="extract" Jul 22 02:21:08.587969 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.587945 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dd21618-79d8-46fe-9cc9-d803bfc40d3f" containerName="extract" Jul 22 02:21:08.588074 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.587976 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dd21618-79d8-46fe-9cc9-d803bfc40d3f" containerName="pull" Jul 22 02:21:08.588074 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.587982 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dd21618-79d8-46fe-9cc9-d803bfc40d3f" containerName="pull" Jul 22 02:21:08.588074 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.588027 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dd21618-79d8-46fe-9cc9-d803bfc40d3f" containerName="extract" Jul 22 02:21:08.591941 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.591922 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-89np7" Jul 22 02:21:08.594913 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.594891 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9fw7w\"" Jul 22 02:21:08.600900 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.600878 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-89np7"] Jul 22 02:21:08.669435 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.669397 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ac6fd4d-69ee-4ade-91eb-d87ddad8fea0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-89np7\" (UID: \"9ac6fd4d-69ee-4ade-91eb-d87ddad8fea0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-89np7" Jul 22 02:21:08.669590 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.669448 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tlgm\" (UniqueName: \"kubernetes.io/projected/9ac6fd4d-69ee-4ade-91eb-d87ddad8fea0-kube-api-access-8tlgm\") pod \"cert-manager-cainjector-559cdd8c87-89np7\" (UID: \"9ac6fd4d-69ee-4ade-91eb-d87ddad8fea0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-89np7" Jul 22 02:21:08.669590 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.669503 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dd21618-79d8-46fe-9cc9-d803bfc40d3f-util\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:21:08.669590 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.669514 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dd21618-79d8-46fe-9cc9-d803bfc40d3f-bundle\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:21:08.669590 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.669523 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwpgl\" (UniqueName: \"kubernetes.io/projected/0dd21618-79d8-46fe-9cc9-d803bfc40d3f-kube-api-access-lwpgl\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:21:08.770667 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.770610 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tlgm\" (UniqueName: \"kubernetes.io/projected/9ac6fd4d-69ee-4ade-91eb-d87ddad8fea0-kube-api-access-8tlgm\") pod \"cert-manager-cainjector-559cdd8c87-89np7\" (UID: \"9ac6fd4d-69ee-4ade-91eb-d87ddad8fea0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-89np7" Jul 22 02:21:08.770844 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.770718 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ac6fd4d-69ee-4ade-91eb-d87ddad8fea0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-89np7\" (UID: \"9ac6fd4d-69ee-4ade-91eb-d87ddad8fea0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-89np7" Jul 22 02:21:08.780735 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.780699 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ac6fd4d-69ee-4ade-91eb-d87ddad8fea0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-89np7\" (UID: \"9ac6fd4d-69ee-4ade-91eb-d87ddad8fea0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-89np7" Jul 22 02:21:08.780895 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.780793 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tlgm\" (UniqueName: \"kubernetes.io/projected/9ac6fd4d-69ee-4ade-91eb-d87ddad8fea0-kube-api-access-8tlgm\") pod \"cert-manager-cainjector-559cdd8c87-89np7\" (UID: \"9ac6fd4d-69ee-4ade-91eb-d87ddad8fea0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-89np7" Jul 22 02:21:08.901661 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:08.901594 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-89np7" Jul 22 02:21:09.030963 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:09.030941 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-89np7"] Jul 22 02:21:09.033050 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:21:09.033027 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ac6fd4d_69ee_4ade_91eb_d87ddad8fea0.slice/crio-397b78763a0ec70a2451dc0dc981e7f372d2efbb8d270c8c376a756b963dd7c1 WatchSource:0}: Error finding container 397b78763a0ec70a2451dc0dc981e7f372d2efbb8d270c8c376a756b963dd7c1: Status 404 returned error can't find the container with id 397b78763a0ec70a2451dc0dc981e7f372d2efbb8d270c8c376a756b963dd7c1 Jul 22 02:21:09.418975 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:09.418942 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-89np7" event={"ID":"9ac6fd4d-69ee-4ade-91eb-d87ddad8fea0","Type":"ContainerStarted","Data":"ad4f996540b8a20603518e4d1e466084cac3967159d95f046ed288e942a66375"} Jul 22 02:21:09.419152 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:09.418988 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-89np7" event={"ID":"9ac6fd4d-69ee-4ade-91eb-d87ddad8fea0","Type":"ContainerStarted","Data":"397b78763a0ec70a2451dc0dc981e7f372d2efbb8d270c8c376a756b963dd7c1"} Jul 22 02:21:09.420839 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:09.420811 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z" event={"ID":"0dd21618-79d8-46fe-9cc9-d803bfc40d3f","Type":"ContainerDied","Data":"6f027136b9a76d1708de2127e0519136ef3163b6fd79f9bbed1d68e473ffa860"} Jul 22 02:21:09.420919 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:09.420847 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8t9z" Jul 22 02:21:09.420919 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:09.420861 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f027136b9a76d1708de2127e0519136ef3163b6fd79f9bbed1d68e473ffa860" Jul 22 02:21:09.437283 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:09.437228 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-89np7" podStartSLOduration=1.437205239 podStartE2EDuration="1.437205239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:21:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:21:09.43459865 +0000 UTC m=+270.543017988" watchObservedRunningTime="2026-07-22 02:21:09.437205239 +0000 UTC m=+270.545624576" Jul 22 02:21:12.410295 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:12.410264 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-jg2vf" Jul 22 02:21:17.145496 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:17.145456 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwk8j"] Jul 22 02:21:17.199575 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:17.199535 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwk8j"] Jul 22 02:21:17.199761 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:17.199665 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwk8j" Jul 22 02:21:17.202704 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:17.202679 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 22 02:21:17.204012 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:17.203985 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-p5zvb\"" Jul 22 02:21:17.204141 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:17.204017 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 22 02:21:17.238419 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:17.238391 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p4hd\" (UniqueName: \"kubernetes.io/projected/6404fddf-2f86-4fd8-b68a-264305a71e5c-kube-api-access-2p4hd\") pod \"openshift-lws-operator-fd8ccff4c-vwk8j\" (UID: \"6404fddf-2f86-4fd8-b68a-264305a71e5c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwk8j" Jul 22 02:21:17.238419 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:17.238425 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6404fddf-2f86-4fd8-b68a-264305a71e5c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vwk8j\" (UID: \"6404fddf-2f86-4fd8-b68a-264305a71e5c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwk8j" Jul 22 02:21:17.339047 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:17.339009 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p4hd\" (UniqueName: \"kubernetes.io/projected/6404fddf-2f86-4fd8-b68a-264305a71e5c-kube-api-access-2p4hd\") pod \"openshift-lws-operator-fd8ccff4c-vwk8j\" (UID: \"6404fddf-2f86-4fd8-b68a-264305a71e5c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwk8j" Jul 22 02:21:17.339047 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:17.339048 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6404fddf-2f86-4fd8-b68a-264305a71e5c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vwk8j\" (UID: \"6404fddf-2f86-4fd8-b68a-264305a71e5c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwk8j" Jul 22 02:21:17.339409 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:17.339390 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6404fddf-2f86-4fd8-b68a-264305a71e5c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vwk8j\" (UID: \"6404fddf-2f86-4fd8-b68a-264305a71e5c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwk8j" Jul 22 02:21:17.348137 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:17.348112 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p4hd\" (UniqueName: \"kubernetes.io/projected/6404fddf-2f86-4fd8-b68a-264305a71e5c-kube-api-access-2p4hd\") pod \"openshift-lws-operator-fd8ccff4c-vwk8j\" (UID: \"6404fddf-2f86-4fd8-b68a-264305a71e5c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwk8j" Jul 22 02:21:17.508908 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:17.508871 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwk8j" Jul 22 02:21:17.657582 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:17.657363 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwk8j"] Jul 22 02:21:17.659827 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:21:17.659798 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6404fddf_2f86_4fd8_b68a_264305a71e5c.slice/crio-64ab1dbc863b0eb839d93dffa33970292d21d3dcbad3d3344348e001cedb9942 WatchSource:0}: Error finding container 64ab1dbc863b0eb839d93dffa33970292d21d3dcbad3d3344348e001cedb9942: Status 404 returned error can't find the container with id 64ab1dbc863b0eb839d93dffa33970292d21d3dcbad3d3344348e001cedb9942 Jul 22 02:21:18.459195 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:18.459158 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwk8j" event={"ID":"6404fddf-2f86-4fd8-b68a-264305a71e5c","Type":"ContainerStarted","Data":"64ab1dbc863b0eb839d93dffa33970292d21d3dcbad3d3344348e001cedb9942"} Jul 22 02:21:22.477601 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:22.477561 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwk8j" event={"ID":"6404fddf-2f86-4fd8-b68a-264305a71e5c","Type":"ContainerStarted","Data":"3a47d4430aadfac6a3dcc86a0867904c4f1fbbb7b484239ea6272951d17036e3"} Jul 22 02:21:22.511889 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:22.511834 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwk8j" podStartSLOduration=1.365928293 podStartE2EDuration="5.511814998s" totalImagesPullingTime="4.145886705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:21:22.510075408 +0000 UTC m=+283.618494762" watchObservedRunningTime="2026-07-22 02:21:22.511814998 +0000 UTC m=+283.620234334" Jul 22 02:21:27.353743 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:27.353709 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz"] Jul 22 02:21:27.356050 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:27.356022 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz" Jul 22 02:21:27.359709 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:27.358918 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cph76\"" Jul 22 02:21:27.359709 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:27.359330 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 02:21:27.360209 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:27.360186 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 02:21:27.365551 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:27.365406 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz"] Jul 22 02:21:27.427835 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:27.427800 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab5daa53-a8cf-456e-ba94-cea6bc7441b7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz\" (UID: \"ab5daa53-a8cf-456e-ba94-cea6bc7441b7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz" Jul 22 02:21:27.427998 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:27.427953 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab5daa53-a8cf-456e-ba94-cea6bc7441b7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz\" (UID: \"ab5daa53-a8cf-456e-ba94-cea6bc7441b7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz" Jul 22 02:21:27.428082 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:27.428006 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2fd6\" (UniqueName: \"kubernetes.io/projected/ab5daa53-a8cf-456e-ba94-cea6bc7441b7-kube-api-access-n2fd6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz\" (UID: \"ab5daa53-a8cf-456e-ba94-cea6bc7441b7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz" Jul 22 02:21:27.528705 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:27.528667 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab5daa53-a8cf-456e-ba94-cea6bc7441b7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz\" (UID: \"ab5daa53-a8cf-456e-ba94-cea6bc7441b7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz" Jul 22 02:21:27.528874 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:27.528757 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab5daa53-a8cf-456e-ba94-cea6bc7441b7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz\" (UID: \"ab5daa53-a8cf-456e-ba94-cea6bc7441b7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz" Jul 22 02:21:27.528874 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:27.528787 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2fd6\" (UniqueName: \"kubernetes.io/projected/ab5daa53-a8cf-456e-ba94-cea6bc7441b7-kube-api-access-n2fd6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz\" (UID: \"ab5daa53-a8cf-456e-ba94-cea6bc7441b7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz" Jul 22 02:21:27.529057 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:27.529036 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab5daa53-a8cf-456e-ba94-cea6bc7441b7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz\" (UID: \"ab5daa53-a8cf-456e-ba94-cea6bc7441b7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz" Jul 22 02:21:27.529152 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:27.529130 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab5daa53-a8cf-456e-ba94-cea6bc7441b7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz\" (UID: \"ab5daa53-a8cf-456e-ba94-cea6bc7441b7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz" Jul 22 02:21:27.537218 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:27.537189 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2fd6\" (UniqueName: \"kubernetes.io/projected/ab5daa53-a8cf-456e-ba94-cea6bc7441b7-kube-api-access-n2fd6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz\" (UID: \"ab5daa53-a8cf-456e-ba94-cea6bc7441b7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz" Jul 22 02:21:27.668757 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:27.668727 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz" Jul 22 02:21:27.816890 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:27.816866 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz"] Jul 22 02:21:27.819360 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:21:27.819331 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab5daa53_a8cf_456e_ba94_cea6bc7441b7.slice/crio-780d7f54331e26391468fc51fd053ffbd9fabfb4b7c457ef0784ddee037bdc3d WatchSource:0}: Error finding container 780d7f54331e26391468fc51fd053ffbd9fabfb4b7c457ef0784ddee037bdc3d: Status 404 returned error can't find the container with id 780d7f54331e26391468fc51fd053ffbd9fabfb4b7c457ef0784ddee037bdc3d Jul 22 02:21:28.506016 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:28.505977 2556 generic.go:356] "Generic (PLEG): container finished" podID="ab5daa53-a8cf-456e-ba94-cea6bc7441b7" containerID="7fbce0d34ec1a41383e76ed435ec58eb2a389ee7d0a550f61df6030c80aab0ed" exitCode=0 Jul 22 02:21:28.506473 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:28.506063 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz" event={"ID":"ab5daa53-a8cf-456e-ba94-cea6bc7441b7","Type":"ContainerDied","Data":"7fbce0d34ec1a41383e76ed435ec58eb2a389ee7d0a550f61df6030c80aab0ed"} Jul 22 02:21:28.506473 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:28.506139 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz" event={"ID":"ab5daa53-a8cf-456e-ba94-cea6bc7441b7","Type":"ContainerStarted","Data":"780d7f54331e26391468fc51fd053ffbd9fabfb4b7c457ef0784ddee037bdc3d"} Jul 22 02:21:29.512590 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:29.512555 2556 generic.go:356] "Generic (PLEG): container finished" podID="ab5daa53-a8cf-456e-ba94-cea6bc7441b7" containerID="faf240b0a982f139a8ed9a510666599a3674c41264bc549ab0937c9a9338d5c2" exitCode=0 Jul 22 02:21:29.513066 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:29.512633 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz" event={"ID":"ab5daa53-a8cf-456e-ba94-cea6bc7441b7","Type":"ContainerDied","Data":"faf240b0a982f139a8ed9a510666599a3674c41264bc549ab0937c9a9338d5c2"} Jul 22 02:21:30.519091 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:30.519056 2556 generic.go:356] "Generic (PLEG): container finished" podID="ab5daa53-a8cf-456e-ba94-cea6bc7441b7" containerID="0cefa06c2c6dfa46b0f286156e685f1cc4a19c463581254245b98d5324542199" exitCode=0 Jul 22 02:21:30.519485 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:30.519106 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz" event={"ID":"ab5daa53-a8cf-456e-ba94-cea6bc7441b7","Type":"ContainerDied","Data":"0cefa06c2c6dfa46b0f286156e685f1cc4a19c463581254245b98d5324542199"} Jul 22 02:21:31.651001 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:31.650979 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz" Jul 22 02:21:31.768095 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:31.768064 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab5daa53-a8cf-456e-ba94-cea6bc7441b7-bundle\") pod \"ab5daa53-a8cf-456e-ba94-cea6bc7441b7\" (UID: \"ab5daa53-a8cf-456e-ba94-cea6bc7441b7\") " Jul 22 02:21:31.768241 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:31.768142 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab5daa53-a8cf-456e-ba94-cea6bc7441b7-util\") pod \"ab5daa53-a8cf-456e-ba94-cea6bc7441b7\" (UID: \"ab5daa53-a8cf-456e-ba94-cea6bc7441b7\") " Jul 22 02:21:31.768241 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:31.768187 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2fd6\" (UniqueName: \"kubernetes.io/projected/ab5daa53-a8cf-456e-ba94-cea6bc7441b7-kube-api-access-n2fd6\") pod \"ab5daa53-a8cf-456e-ba94-cea6bc7441b7\" (UID: \"ab5daa53-a8cf-456e-ba94-cea6bc7441b7\") " Jul 22 02:21:31.768926 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:31.768896 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab5daa53-a8cf-456e-ba94-cea6bc7441b7-bundle" (OuterVolumeSpecName: "bundle") pod "ab5daa53-a8cf-456e-ba94-cea6bc7441b7" (UID: "ab5daa53-a8cf-456e-ba94-cea6bc7441b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:21:31.770286 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:31.770263 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab5daa53-a8cf-456e-ba94-cea6bc7441b7-kube-api-access-n2fd6" (OuterVolumeSpecName: "kube-api-access-n2fd6") pod "ab5daa53-a8cf-456e-ba94-cea6bc7441b7" (UID: "ab5daa53-a8cf-456e-ba94-cea6bc7441b7"). InnerVolumeSpecName "kube-api-access-n2fd6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:21:31.774127 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:31.774065 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab5daa53-a8cf-456e-ba94-cea6bc7441b7-util" (OuterVolumeSpecName: "util") pod "ab5daa53-a8cf-456e-ba94-cea6bc7441b7" (UID: "ab5daa53-a8cf-456e-ba94-cea6bc7441b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:21:31.869278 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:31.869240 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2fd6\" (UniqueName: \"kubernetes.io/projected/ab5daa53-a8cf-456e-ba94-cea6bc7441b7-kube-api-access-n2fd6\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:21:31.869278 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:31.869272 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab5daa53-a8cf-456e-ba94-cea6bc7441b7-bundle\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:21:31.869278 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:31.869282 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab5daa53-a8cf-456e-ba94-cea6bc7441b7-util\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:21:32.529514 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:32.529429 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz" event={"ID":"ab5daa53-a8cf-456e-ba94-cea6bc7441b7","Type":"ContainerDied","Data":"780d7f54331e26391468fc51fd053ffbd9fabfb4b7c457ef0784ddee037bdc3d"} Jul 22 02:21:32.529514 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:32.529472 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggvmz" Jul 22 02:21:32.529514 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:32.529481 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="780d7f54331e26391468fc51fd053ffbd9fabfb4b7c457ef0784ddee037bdc3d" Jul 22 02:21:37.472631 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.472599 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh"] Jul 22 02:21:37.473099 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.472902 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab5daa53-a8cf-456e-ba94-cea6bc7441b7" containerName="extract" Jul 22 02:21:37.473099 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.472913 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab5daa53-a8cf-456e-ba94-cea6bc7441b7" containerName="extract" Jul 22 02:21:37.473099 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.472922 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab5daa53-a8cf-456e-ba94-cea6bc7441b7" containerName="pull" Jul 22 02:21:37.473099 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.472928 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab5daa53-a8cf-456e-ba94-cea6bc7441b7" containerName="pull" Jul 22 02:21:37.473099 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.472940 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab5daa53-a8cf-456e-ba94-cea6bc7441b7" containerName="util" Jul 22 02:21:37.473099 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.472946 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab5daa53-a8cf-456e-ba94-cea6bc7441b7" containerName="util" Jul 22 02:21:37.473099 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.472993 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab5daa53-a8cf-456e-ba94-cea6bc7441b7" containerName="extract" Jul 22 02:21:37.476209 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.476187 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh" Jul 22 02:21:37.481772 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.481748 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 22 02:21:37.482891 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.482858 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 22 02:21:37.483018 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.482868 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 22 02:21:37.483150 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.483120 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5zfmq\"" Jul 22 02:21:37.488331 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.488309 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh"] Jul 22 02:21:37.618658 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.618617 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04406e8d-ad67-47c3-99f0-5c0c58ff32bb-cert\") pod \"lws-controller-manager-6c9bd579-nktzh\" (UID: \"04406e8d-ad67-47c3-99f0-5c0c58ff32bb\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh" Jul 22 02:21:37.618843 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.618724 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/04406e8d-ad67-47c3-99f0-5c0c58ff32bb-manager-config\") pod \"lws-controller-manager-6c9bd579-nktzh\" (UID: \"04406e8d-ad67-47c3-99f0-5c0c58ff32bb\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh" Jul 22 02:21:37.618843 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.618765 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbx94\" (UniqueName: \"kubernetes.io/projected/04406e8d-ad67-47c3-99f0-5c0c58ff32bb-kube-api-access-mbx94\") pod \"lws-controller-manager-6c9bd579-nktzh\" (UID: \"04406e8d-ad67-47c3-99f0-5c0c58ff32bb\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh" Jul 22 02:21:37.618843 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.618804 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/04406e8d-ad67-47c3-99f0-5c0c58ff32bb-metrics-cert\") pod \"lws-controller-manager-6c9bd579-nktzh\" (UID: \"04406e8d-ad67-47c3-99f0-5c0c58ff32bb\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh" Jul 22 02:21:37.720125 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.720092 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04406e8d-ad67-47c3-99f0-5c0c58ff32bb-cert\") pod \"lws-controller-manager-6c9bd579-nktzh\" (UID: \"04406e8d-ad67-47c3-99f0-5c0c58ff32bb\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh" Jul 22 02:21:37.720236 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.720148 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/04406e8d-ad67-47c3-99f0-5c0c58ff32bb-manager-config\") pod \"lws-controller-manager-6c9bd579-nktzh\" (UID: \"04406e8d-ad67-47c3-99f0-5c0c58ff32bb\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh" Jul 22 02:21:37.720236 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.720174 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbx94\" (UniqueName: \"kubernetes.io/projected/04406e8d-ad67-47c3-99f0-5c0c58ff32bb-kube-api-access-mbx94\") pod \"lws-controller-manager-6c9bd579-nktzh\" (UID: \"04406e8d-ad67-47c3-99f0-5c0c58ff32bb\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh" Jul 22 02:21:37.720236 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.720217 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/04406e8d-ad67-47c3-99f0-5c0c58ff32bb-metrics-cert\") pod \"lws-controller-manager-6c9bd579-nktzh\" (UID: \"04406e8d-ad67-47c3-99f0-5c0c58ff32bb\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh" Jul 22 02:21:37.720929 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.720905 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/04406e8d-ad67-47c3-99f0-5c0c58ff32bb-manager-config\") pod \"lws-controller-manager-6c9bd579-nktzh\" (UID: \"04406e8d-ad67-47c3-99f0-5c0c58ff32bb\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh" Jul 22 02:21:37.722480 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.722452 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/04406e8d-ad67-47c3-99f0-5c0c58ff32bb-metrics-cert\") pod \"lws-controller-manager-6c9bd579-nktzh\" (UID: \"04406e8d-ad67-47c3-99f0-5c0c58ff32bb\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh" Jul 22 02:21:37.722582 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.722546 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04406e8d-ad67-47c3-99f0-5c0c58ff32bb-cert\") pod \"lws-controller-manager-6c9bd579-nktzh\" (UID: \"04406e8d-ad67-47c3-99f0-5c0c58ff32bb\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh" Jul 22 02:21:37.730377 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.730323 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbx94\" (UniqueName: \"kubernetes.io/projected/04406e8d-ad67-47c3-99f0-5c0c58ff32bb-kube-api-access-mbx94\") pod \"lws-controller-manager-6c9bd579-nktzh\" (UID: \"04406e8d-ad67-47c3-99f0-5c0c58ff32bb\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh" Jul 22 02:21:37.791150 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.791105 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh" Jul 22 02:21:37.934967 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:37.934942 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh"] Jul 22 02:21:37.936794 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:21:37.936761 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04406e8d_ad67_47c3_99f0_5c0c58ff32bb.slice/crio-5fd8d6da63b675f05091d8c507d37c2587049f9a6399af96fb741c35f37693be WatchSource:0}: Error finding container 5fd8d6da63b675f05091d8c507d37c2587049f9a6399af96fb741c35f37693be: Status 404 returned error can't find the container with id 5fd8d6da63b675f05091d8c507d37c2587049f9a6399af96fb741c35f37693be Jul 22 02:21:38.556775 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:38.556741 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh" event={"ID":"04406e8d-ad67-47c3-99f0-5c0c58ff32bb","Type":"ContainerStarted","Data":"5fd8d6da63b675f05091d8c507d37c2587049f9a6399af96fb741c35f37693be"} Jul 22 02:21:39.071762 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.071727 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq"] Jul 22 02:21:39.075214 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.075197 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" Jul 22 02:21:39.079441 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.079420 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 22 02:21:39.079593 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.079470 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5fjrz\"" Jul 22 02:21:39.079593 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.079527 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 22 02:21:39.079787 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.079771 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 22 02:21:39.079896 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.079881 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 22 02:21:39.098615 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.098586 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq"] Jul 22 02:21:39.235221 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.235187 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8b16709-c38a-4416-a85a-1f16c833c0cc-manifests\") pod \"opendatahub-operator-controller-manager-57f477d5fd-xg8nq\" (UID: \"a8b16709-c38a-4416-a85a-1f16c833c0cc\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" Jul 22 02:21:39.235402 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.235244 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8b16709-c38a-4416-a85a-1f16c833c0cc-tmp\") pod \"opendatahub-operator-controller-manager-57f477d5fd-xg8nq\" (UID: \"a8b16709-c38a-4416-a85a-1f16c833c0cc\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" Jul 22 02:21:39.235402 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.235344 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8b16709-c38a-4416-a85a-1f16c833c0cc-webhook-cert\") pod \"opendatahub-operator-controller-manager-57f477d5fd-xg8nq\" (UID: \"a8b16709-c38a-4416-a85a-1f16c833c0cc\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" Jul 22 02:21:39.235402 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.235386 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxfxd\" (UniqueName: \"kubernetes.io/projected/a8b16709-c38a-4416-a85a-1f16c833c0cc-kube-api-access-dxfxd\") pod \"opendatahub-operator-controller-manager-57f477d5fd-xg8nq\" (UID: \"a8b16709-c38a-4416-a85a-1f16c833c0cc\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" Jul 22 02:21:39.235544 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.235484 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8b16709-c38a-4416-a85a-1f16c833c0cc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57f477d5fd-xg8nq\" (UID: \"a8b16709-c38a-4416-a85a-1f16c833c0cc\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" Jul 22 02:21:39.336558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.336456 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8b16709-c38a-4416-a85a-1f16c833c0cc-webhook-cert\") pod \"opendatahub-operator-controller-manager-57f477d5fd-xg8nq\" (UID: \"a8b16709-c38a-4416-a85a-1f16c833c0cc\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" Jul 22 02:21:39.336558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.336556 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxfxd\" (UniqueName: \"kubernetes.io/projected/a8b16709-c38a-4416-a85a-1f16c833c0cc-kube-api-access-dxfxd\") pod \"opendatahub-operator-controller-manager-57f477d5fd-xg8nq\" (UID: \"a8b16709-c38a-4416-a85a-1f16c833c0cc\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" Jul 22 02:21:39.336803 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.336673 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8b16709-c38a-4416-a85a-1f16c833c0cc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57f477d5fd-xg8nq\" (UID: \"a8b16709-c38a-4416-a85a-1f16c833c0cc\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" Jul 22 02:21:39.336803 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.336719 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8b16709-c38a-4416-a85a-1f16c833c0cc-manifests\") pod \"opendatahub-operator-controller-manager-57f477d5fd-xg8nq\" (UID: \"a8b16709-c38a-4416-a85a-1f16c833c0cc\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" Jul 22 02:21:39.336910 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.336809 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8b16709-c38a-4416-a85a-1f16c833c0cc-tmp\") pod \"opendatahub-operator-controller-manager-57f477d5fd-xg8nq\" (UID: \"a8b16709-c38a-4416-a85a-1f16c833c0cc\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" Jul 22 02:21:39.337475 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.337429 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8b16709-c38a-4416-a85a-1f16c833c0cc-manifests\") pod \"opendatahub-operator-controller-manager-57f477d5fd-xg8nq\" (UID: \"a8b16709-c38a-4416-a85a-1f16c833c0cc\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" Jul 22 02:21:39.339657 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.339612 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8b16709-c38a-4416-a85a-1f16c833c0cc-tmp\") pod \"opendatahub-operator-controller-manager-57f477d5fd-xg8nq\" (UID: \"a8b16709-c38a-4416-a85a-1f16c833c0cc\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" Jul 22 02:21:39.339840 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.339772 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8b16709-c38a-4416-a85a-1f16c833c0cc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57f477d5fd-xg8nq\" (UID: \"a8b16709-c38a-4416-a85a-1f16c833c0cc\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" Jul 22 02:21:39.340157 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.340138 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8b16709-c38a-4416-a85a-1f16c833c0cc-webhook-cert\") pod \"opendatahub-operator-controller-manager-57f477d5fd-xg8nq\" (UID: \"a8b16709-c38a-4416-a85a-1f16c833c0cc\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" Jul 22 02:21:39.347439 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.347406 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxfxd\" (UniqueName: \"kubernetes.io/projected/a8b16709-c38a-4416-a85a-1f16c833c0cc-kube-api-access-dxfxd\") pod \"opendatahub-operator-controller-manager-57f477d5fd-xg8nq\" (UID: \"a8b16709-c38a-4416-a85a-1f16c833c0cc\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" Jul 22 02:21:39.386404 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.386372 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" Jul 22 02:21:39.534031 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.533994 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq"] Jul 22 02:21:39.535903 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:21:39.535871 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8b16709_c38a_4416_a85a_1f16c833c0cc.slice/crio-57572844e057ef6a89fcdff447e40ba684491e80c3930e1ee48a14769b56afb4 WatchSource:0}: Error finding container 57572844e057ef6a89fcdff447e40ba684491e80c3930e1ee48a14769b56afb4: Status 404 returned error can't find the container with id 57572844e057ef6a89fcdff447e40ba684491e80c3930e1ee48a14769b56afb4 Jul 22 02:21:39.565034 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.564990 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" event={"ID":"a8b16709-c38a-4416-a85a-1f16c833c0cc","Type":"ContainerStarted","Data":"57572844e057ef6a89fcdff447e40ba684491e80c3930e1ee48a14769b56afb4"} Jul 22 02:21:39.577014 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:39.576991 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 22 02:21:40.573045 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:40.573005 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh" event={"ID":"04406e8d-ad67-47c3-99f0-5c0c58ff32bb","Type":"ContainerStarted","Data":"d83145f67e73c11aca905ccbb83ff05824778c47ebbbb85e4e5ab497f8fdee5c"} Jul 22 02:21:40.573548 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:40.573273 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh" Jul 22 02:21:40.594265 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:40.594197 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh" podStartSLOduration=1.38907988 podStartE2EDuration="3.594175682s" totalImagesPullingTime="2.205095802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:21:40.592201459 +0000 UTC m=+301.700620837" watchObservedRunningTime="2026-07-22 02:21:40.594175682 +0000 UTC m=+301.702595021" Jul 22 02:21:43.589497 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:43.589454 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" event={"ID":"a8b16709-c38a-4416-a85a-1f16c833c0cc","Type":"ContainerStarted","Data":"0d9ff1ef9407f10e7ba98c620ca7a40db9c67b3f5c87315cc0ea2d84e76c2d28"} Jul 22 02:21:44.594871 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:44.594835 2556 generic.go:356] "Generic (PLEG): container finished" podID="a8b16709-c38a-4416-a85a-1f16c833c0cc" containerID="0d9ff1ef9407f10e7ba98c620ca7a40db9c67b3f5c87315cc0ea2d84e76c2d28" exitCode=0 Jul 22 02:21:44.595283 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:44.594916 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" event={"ID":"a8b16709-c38a-4416-a85a-1f16c833c0cc","Type":"ContainerDied","Data":"0d9ff1ef9407f10e7ba98c620ca7a40db9c67b3f5c87315cc0ea2d84e76c2d28"} Jul 22 02:21:44.595417 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:44.595402 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 02:21:45.606121 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:45.606077 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" event={"ID":"a8b16709-c38a-4416-a85a-1f16c833c0cc","Type":"ContainerStarted","Data":"c4100891fb50abd07fb6c90698bde5a6caedc678beb1133409f302b162d1eeb2"} Jul 22 02:21:45.606585 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:45.606224 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" Jul 22 02:21:45.635684 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:45.635605 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" podStartSLOduration=2.070341865 podStartE2EDuration="6.635588999s" totalImagesPullingTime="3.558989217s" totalInitContainerRuntime="1.006257917s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:21:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:21:45.633253985 +0000 UTC m=+306.741673331" watchObservedRunningTime="2026-07-22 02:21:45.635588999 +0000 UTC m=+306.744008336" Jul 22 02:21:51.580733 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:51.580701 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c9bd579-nktzh" Jul 22 02:21:56.613020 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:21:56.612992 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-xg8nq" Jul 22 02:22:06.557107 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.557074 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl"] Jul 22 02:22:06.560420 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.560402 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.563586 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.563557 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 22 02:22:06.563738 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.563624 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 22 02:22:06.563738 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.563631 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 22 02:22:06.563973 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.563955 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-nqc2p\"" Jul 22 02:22:06.573206 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.573184 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl"] Jul 22 02:22:06.663213 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.663173 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a210b64-0b49-4c52-a35c-622b7e3fa062-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.663213 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.663215 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a210b64-0b49-4c52-a35c-622b7e3fa062-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.663423 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.663231 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a210b64-0b49-4c52-a35c-622b7e3fa062-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.663423 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.663247 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a210b64-0b49-4c52-a35c-622b7e3fa062-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.663423 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.663309 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a210b64-0b49-4c52-a35c-622b7e3fa062-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.663423 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.663356 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a210b64-0b49-4c52-a35c-622b7e3fa062-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.663423 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.663381 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htjfh\" (UniqueName: \"kubernetes.io/projected/2a210b64-0b49-4c52-a35c-622b7e3fa062-kube-api-access-htjfh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.663576 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.663421 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a210b64-0b49-4c52-a35c-622b7e3fa062-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.663576 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.663454 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a210b64-0b49-4c52-a35c-622b7e3fa062-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.764601 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.764564 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a210b64-0b49-4c52-a35c-622b7e3fa062-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.764601 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.764611 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a210b64-0b49-4c52-a35c-622b7e3fa062-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.764831 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.764709 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a210b64-0b49-4c52-a35c-622b7e3fa062-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.764831 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.764743 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a210b64-0b49-4c52-a35c-622b7e3fa062-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.764831 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.764767 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a210b64-0b49-4c52-a35c-622b7e3fa062-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.764968 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.764923 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a210b64-0b49-4c52-a35c-622b7e3fa062-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.765023 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.764990 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a210b64-0b49-4c52-a35c-622b7e3fa062-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.765076 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.765030 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a210b64-0b49-4c52-a35c-622b7e3fa062-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.765126 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.765072 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a210b64-0b49-4c52-a35c-622b7e3fa062-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.765126 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.765074 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htjfh\" (UniqueName: \"kubernetes.io/projected/2a210b64-0b49-4c52-a35c-622b7e3fa062-kube-api-access-htjfh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.765538 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.765100 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a210b64-0b49-4c52-a35c-622b7e3fa062-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.765538 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.765228 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a210b64-0b49-4c52-a35c-622b7e3fa062-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.765538 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.765358 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a210b64-0b49-4c52-a35c-622b7e3fa062-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.765538 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.765516 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a210b64-0b49-4c52-a35c-622b7e3fa062-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.767239 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.767217 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a210b64-0b49-4c52-a35c-622b7e3fa062-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.767444 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.767424 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a210b64-0b49-4c52-a35c-622b7e3fa062-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.780420 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.780390 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a210b64-0b49-4c52-a35c-622b7e3fa062-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.780765 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.780746 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htjfh\" (UniqueName: \"kubernetes.io/projected/2a210b64-0b49-4c52-a35c-622b7e3fa062-kube-api-access-htjfh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxssl\" (UID: \"2a210b64-0b49-4c52-a35c-622b7e3fa062\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:06.870879 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:06.870790 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:07.014413 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.014388 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl"] Jul 22 02:22:07.016078 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:22:07.016053 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a210b64_0b49_4c52_a35c_622b7e3fa062.slice/crio-102d353999b57aeaa52ead596cd2b565bff17ad463711036b6a4a5eca69e3a03 WatchSource:0}: Error finding container 102d353999b57aeaa52ead596cd2b565bff17ad463711036b6a4a5eca69e3a03: Status 404 returned error can't find the container with id 102d353999b57aeaa52ead596cd2b565bff17ad463711036b6a4a5eca69e3a03 Jul 22 02:22:07.313238 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.313206 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs"] Jul 22 02:22:07.317766 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.317748 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.321102 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.320930 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 22 02:22:07.321102 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.320982 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 22 02:22:07.321102 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.320985 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 22 02:22:07.321102 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.320940 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wl94r\"" Jul 22 02:22:07.335897 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.335871 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs"] Jul 22 02:22:07.370185 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.370154 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04628628-c241-4318-b2cf-5054b3be506a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.370350 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.370190 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5ns9\" (UniqueName: \"kubernetes.io/projected/04628628-c241-4318-b2cf-5054b3be506a-kube-api-access-r5ns9\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.370350 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.370226 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04628628-c241-4318-b2cf-5054b3be506a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.370350 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.370272 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04628628-c241-4318-b2cf-5054b3be506a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.370350 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.370304 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04628628-c241-4318-b2cf-5054b3be506a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.370350 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.370342 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04628628-c241-4318-b2cf-5054b3be506a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.370608 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.370510 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04628628-c241-4318-b2cf-5054b3be506a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.471552 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.471514 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04628628-c241-4318-b2cf-5054b3be506a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.471777 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.471604 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04628628-c241-4318-b2cf-5054b3be506a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.471777 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.471623 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5ns9\" (UniqueName: \"kubernetes.io/projected/04628628-c241-4318-b2cf-5054b3be506a-kube-api-access-r5ns9\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.471777 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.471681 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04628628-c241-4318-b2cf-5054b3be506a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.471777 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.471705 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04628628-c241-4318-b2cf-5054b3be506a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.471983 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.471814 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04628628-c241-4318-b2cf-5054b3be506a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.471983 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.471869 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04628628-c241-4318-b2cf-5054b3be506a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.472518 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.472491 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04628628-c241-4318-b2cf-5054b3be506a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.474038 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.474016 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04628628-c241-4318-b2cf-5054b3be506a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.474038 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.474030 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04628628-c241-4318-b2cf-5054b3be506a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.474212 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.474185 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04628628-c241-4318-b2cf-5054b3be506a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.474287 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.474266 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04628628-c241-4318-b2cf-5054b3be506a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.491465 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.491437 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04628628-c241-4318-b2cf-5054b3be506a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.491616 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.491596 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5ns9\" (UniqueName: \"kubernetes.io/projected/04628628-c241-4318-b2cf-5054b3be506a-kube-api-access-r5ns9\") pod \"istiod-openshift-gateway-94bb8fbfd-wxkbs\" (UID: \"04628628-c241-4318-b2cf-5054b3be506a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.628315 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.628225 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:07.716167 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.716126 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" event={"ID":"2a210b64-0b49-4c52-a35c-622b7e3fa062","Type":"ContainerStarted","Data":"102d353999b57aeaa52ead596cd2b565bff17ad463711036b6a4a5eca69e3a03"} Jul 22 02:22:07.775510 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:07.775441 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs"] Jul 22 02:22:07.778310 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:22:07.778278 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04628628_c241_4318_b2cf_5054b3be506a.slice/crio-c49516e4208ed285b5d092910ea497d356607262074c39987e78d4e71fda517e WatchSource:0}: Error finding container c49516e4208ed285b5d092910ea497d356607262074c39987e78d4e71fda517e: Status 404 returned error can't find the container with id c49516e4208ed285b5d092910ea497d356607262074c39987e78d4e71fda517e Jul 22 02:22:08.723111 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:08.723029 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" event={"ID":"04628628-c241-4318-b2cf-5054b3be506a","Type":"ContainerStarted","Data":"c49516e4208ed285b5d092910ea497d356607262074c39987e78d4e71fda517e"} Jul 22 02:22:10.227393 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:10.227337 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:22:10.227694 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:10.227426 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:22:10.227694 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:10.227468 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:22:10.738078 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:10.738040 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" event={"ID":"2a210b64-0b49-4c52-a35c-622b7e3fa062","Type":"ContainerStarted","Data":"344eea88281c8cabe8836210aef6576baf993c45aa0c81860bc3308e246f022d"} Jul 22 02:22:10.762023 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:10.761965 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" podStartSLOduration=1.553385387 podStartE2EDuration="4.761947715s" totalImagesPullingTime="3.208562328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:22:10.759563594 +0000 UTC m=+331.867982931" watchObservedRunningTime="2026-07-22 02:22:10.761947715 +0000 UTC m=+331.870367051" Jul 22 02:22:10.870922 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:10.870878 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:11.510182 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:11.510138 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:22:11.510444 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:11.510223 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:22:11.744812 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:11.744773 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" event={"ID":"04628628-c241-4318-b2cf-5054b3be506a","Type":"ContainerStarted","Data":"a12b9e58fefd8aff886e3a6b23ca3eda85964e4c3ce73dcc3123e7d2d06a4bb5"} Jul 22 02:22:11.745306 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:11.744992 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:22:11.785190 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:11.785085 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" podStartSLOduration=1.055433797 podStartE2EDuration="4.785069082s" totalImagesPullingTime="3.729635285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:22:11.784554995 +0000 UTC m=+332.892974331" watchObservedRunningTime="2026-07-22 02:22:11.785069082 +0000 UTC m=+332.893488419" Jul 22 02:22:11.876394 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:11.876358 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:12.750457 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:12.750422 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:12.751431 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:12.751407 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxssl" Jul 22 02:22:12.752029 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:22:12.752004 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wxkbs" Jul 22 02:23:29.866299 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:29.866265 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf"] Jul 22 02:23:29.869455 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:29.869438 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf" Jul 22 02:23:29.872567 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:29.872545 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 22 02:23:29.872567 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:29.872546 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 22 02:23:29.873615 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:29.873597 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t62r7\"" Jul 22 02:23:29.878454 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:29.878431 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf"] Jul 22 02:23:29.902456 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:29.902418 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf\" (UID: \"e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf" Jul 22 02:23:29.902612 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:29.902478 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf\" (UID: \"e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf" Jul 22 02:23:29.902612 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:29.902565 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmwbx\" (UniqueName: \"kubernetes.io/projected/e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7-kube-api-access-rmwbx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf\" (UID: \"e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf" Jul 22 02:23:29.980495 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:29.980463 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m"] Jul 22 02:23:29.982782 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:29.982764 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m" Jul 22 02:23:29.992179 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:29.992155 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m"] Jul 22 02:23:30.003514 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.003484 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf\" (UID: \"e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf" Jul 22 02:23:30.003697 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.003531 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/869a4831-c73d-413b-94d1-f06ed4c19b23-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m\" (UID: \"869a4831-c73d-413b-94d1-f06ed4c19b23\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m" Jul 22 02:23:30.003697 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.003575 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf\" (UID: \"e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf" Jul 22 02:23:30.003697 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.003606 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4d2l\" (UniqueName: \"kubernetes.io/projected/869a4831-c73d-413b-94d1-f06ed4c19b23-kube-api-access-l4d2l\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m\" (UID: \"869a4831-c73d-413b-94d1-f06ed4c19b23\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m" Jul 22 02:23:30.003832 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.003715 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmwbx\" (UniqueName: \"kubernetes.io/projected/e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7-kube-api-access-rmwbx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf\" (UID: \"e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf" Jul 22 02:23:30.003832 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.003767 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/869a4831-c73d-413b-94d1-f06ed4c19b23-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m\" (UID: \"869a4831-c73d-413b-94d1-f06ed4c19b23\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m" Jul 22 02:23:30.003951 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.003930 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf\" (UID: \"e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf" Jul 22 02:23:30.003987 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.003950 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf\" (UID: \"e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf" Jul 22 02:23:30.013032 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.013002 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmwbx\" (UniqueName: \"kubernetes.io/projected/e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7-kube-api-access-rmwbx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf\" (UID: \"e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf" Jul 22 02:23:30.104310 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.104278 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/869a4831-c73d-413b-94d1-f06ed4c19b23-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m\" (UID: \"869a4831-c73d-413b-94d1-f06ed4c19b23\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m" Jul 22 02:23:30.104484 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.104345 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/869a4831-c73d-413b-94d1-f06ed4c19b23-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m\" (UID: \"869a4831-c73d-413b-94d1-f06ed4c19b23\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m" Jul 22 02:23:30.104484 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.104395 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4d2l\" (UniqueName: \"kubernetes.io/projected/869a4831-c73d-413b-94d1-f06ed4c19b23-kube-api-access-l4d2l\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m\" (UID: \"869a4831-c73d-413b-94d1-f06ed4c19b23\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m" Jul 22 02:23:30.104783 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.104760 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/869a4831-c73d-413b-94d1-f06ed4c19b23-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m\" (UID: \"869a4831-c73d-413b-94d1-f06ed4c19b23\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m" Jul 22 02:23:30.104834 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.104767 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/869a4831-c73d-413b-94d1-f06ed4c19b23-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m\" (UID: \"869a4831-c73d-413b-94d1-f06ed4c19b23\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m" Jul 22 02:23:30.112775 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.112750 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4d2l\" (UniqueName: \"kubernetes.io/projected/869a4831-c73d-413b-94d1-f06ed4c19b23-kube-api-access-l4d2l\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m\" (UID: \"869a4831-c73d-413b-94d1-f06ed4c19b23\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m" Jul 22 02:23:30.178570 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.178540 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf" Jul 22 02:23:30.276153 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.276123 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn"] Jul 22 02:23:30.286763 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.286568 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn" Jul 22 02:23:30.290400 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.290367 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn"] Jul 22 02:23:30.292354 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.292329 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m" Jul 22 02:23:30.306387 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.306355 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/409f3291-97e8-4cd9-8e3a-20d37af25b62-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn\" (UID: \"409f3291-97e8-4cd9-8e3a-20d37af25b62\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn" Jul 22 02:23:30.306513 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.306422 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/409f3291-97e8-4cd9-8e3a-20d37af25b62-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn\" (UID: \"409f3291-97e8-4cd9-8e3a-20d37af25b62\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn" Jul 22 02:23:30.306581 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.306545 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfjdx\" (UniqueName: \"kubernetes.io/projected/409f3291-97e8-4cd9-8e3a-20d37af25b62-kube-api-access-sfjdx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn\" (UID: \"409f3291-97e8-4cd9-8e3a-20d37af25b62\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn" Jul 22 02:23:30.314397 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.314365 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf"] Jul 22 02:23:30.315203 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:23:30.315176 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode89a4ec6_6698_4f5a_b9ee_8419ec85fdf7.slice/crio-5e54e9783142521da927284a4e3e81b90f65f6b03f98217a8263916c9b622297 WatchSource:0}: Error finding container 5e54e9783142521da927284a4e3e81b90f65f6b03f98217a8263916c9b622297: Status 404 returned error can't find the container with id 5e54e9783142521da927284a4e3e81b90f65f6b03f98217a8263916c9b622297 Jul 22 02:23:30.407895 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.407859 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/409f3291-97e8-4cd9-8e3a-20d37af25b62-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn\" (UID: \"409f3291-97e8-4cd9-8e3a-20d37af25b62\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn" Jul 22 02:23:30.408079 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.407912 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/409f3291-97e8-4cd9-8e3a-20d37af25b62-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn\" (UID: \"409f3291-97e8-4cd9-8e3a-20d37af25b62\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn" Jul 22 02:23:30.408079 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.407982 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfjdx\" (UniqueName: \"kubernetes.io/projected/409f3291-97e8-4cd9-8e3a-20d37af25b62-kube-api-access-sfjdx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn\" (UID: \"409f3291-97e8-4cd9-8e3a-20d37af25b62\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn" Jul 22 02:23:30.408381 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.408346 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/409f3291-97e8-4cd9-8e3a-20d37af25b62-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn\" (UID: \"409f3291-97e8-4cd9-8e3a-20d37af25b62\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn" Jul 22 02:23:30.408454 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.408376 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/409f3291-97e8-4cd9-8e3a-20d37af25b62-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn\" (UID: \"409f3291-97e8-4cd9-8e3a-20d37af25b62\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn" Jul 22 02:23:30.417139 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.417111 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfjdx\" (UniqueName: \"kubernetes.io/projected/409f3291-97e8-4cd9-8e3a-20d37af25b62-kube-api-access-sfjdx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn\" (UID: \"409f3291-97e8-4cd9-8e3a-20d37af25b62\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn" Jul 22 02:23:30.434836 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.434812 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m"] Jul 22 02:23:30.436800 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:23:30.436771 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod869a4831_c73d_413b_94d1_f06ed4c19b23.slice/crio-00040649faf734f98f7289a65a8daad99a1fe8c19faed6a3c04e814f299480d3 WatchSource:0}: Error finding container 00040649faf734f98f7289a65a8daad99a1fe8c19faed6a3c04e814f299480d3: Status 404 returned error can't find the container with id 00040649faf734f98f7289a65a8daad99a1fe8c19faed6a3c04e814f299480d3 Jul 22 02:23:30.599932 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.599902 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn" Jul 22 02:23:30.675556 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.675526 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd"] Jul 22 02:23:30.679766 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.679739 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd" Jul 22 02:23:30.688353 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.688289 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd"] Jul 22 02:23:30.710570 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.710539 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9e2a6a0-502e-4149-bd20-e63882835f24-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd\" (UID: \"f9e2a6a0-502e-4149-bd20-e63882835f24\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd" Jul 22 02:23:30.710778 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.710688 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9e2a6a0-502e-4149-bd20-e63882835f24-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd\" (UID: \"f9e2a6a0-502e-4149-bd20-e63882835f24\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd" Jul 22 02:23:30.710778 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.710714 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5nts\" (UniqueName: \"kubernetes.io/projected/f9e2a6a0-502e-4149-bd20-e63882835f24-kube-api-access-f5nts\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd\" (UID: \"f9e2a6a0-502e-4149-bd20-e63882835f24\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd" Jul 22 02:23:30.731368 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.731347 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn"] Jul 22 02:23:30.733128 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:23:30.733098 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod409f3291_97e8_4cd9_8e3a_20d37af25b62.slice/crio-75e521d37f21a83320587882966f8170913abfde66e20b7e5c8abb4361ba5257 WatchSource:0}: Error finding container 75e521d37f21a83320587882966f8170913abfde66e20b7e5c8abb4361ba5257: Status 404 returned error can't find the container with id 75e521d37f21a83320587882966f8170913abfde66e20b7e5c8abb4361ba5257 Jul 22 02:23:30.811842 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.811805 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9e2a6a0-502e-4149-bd20-e63882835f24-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd\" (UID: \"f9e2a6a0-502e-4149-bd20-e63882835f24\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd" Jul 22 02:23:30.812029 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.811917 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9e2a6a0-502e-4149-bd20-e63882835f24-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd\" (UID: \"f9e2a6a0-502e-4149-bd20-e63882835f24\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd" Jul 22 02:23:30.812029 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.811939 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5nts\" (UniqueName: \"kubernetes.io/projected/f9e2a6a0-502e-4149-bd20-e63882835f24-kube-api-access-f5nts\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd\" (UID: \"f9e2a6a0-502e-4149-bd20-e63882835f24\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd" Jul 22 02:23:30.812246 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.812223 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9e2a6a0-502e-4149-bd20-e63882835f24-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd\" (UID: \"f9e2a6a0-502e-4149-bd20-e63882835f24\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd" Jul 22 02:23:30.812348 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.812323 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9e2a6a0-502e-4149-bd20-e63882835f24-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd\" (UID: \"f9e2a6a0-502e-4149-bd20-e63882835f24\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd" Jul 22 02:23:30.821756 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.821733 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5nts\" (UniqueName: \"kubernetes.io/projected/f9e2a6a0-502e-4149-bd20-e63882835f24-kube-api-access-f5nts\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd\" (UID: \"f9e2a6a0-502e-4149-bd20-e63882835f24\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd" Jul 22 02:23:30.992560 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:30.992469 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd" Jul 22 02:23:31.106133 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:31.106103 2556 generic.go:356] "Generic (PLEG): container finished" podID="869a4831-c73d-413b-94d1-f06ed4c19b23" containerID="05ddf69a1eaeb095425c8f9977ff888b8bc187af6015f647962a316fe122d91f" exitCode=0 Jul 22 02:23:31.106279 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:31.106184 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m" event={"ID":"869a4831-c73d-413b-94d1-f06ed4c19b23","Type":"ContainerDied","Data":"05ddf69a1eaeb095425c8f9977ff888b8bc187af6015f647962a316fe122d91f"} Jul 22 02:23:31.106279 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:31.106244 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m" event={"ID":"869a4831-c73d-413b-94d1-f06ed4c19b23","Type":"ContainerStarted","Data":"00040649faf734f98f7289a65a8daad99a1fe8c19faed6a3c04e814f299480d3"} Jul 22 02:23:31.107978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:31.107953 2556 generic.go:356] "Generic (PLEG): container finished" podID="e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7" containerID="32853355cae5602ac6a5daeeee86494aac6ead3cd6fb79861d90fc54faaaa751" exitCode=0 Jul 22 02:23:31.108100 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:31.108040 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf" event={"ID":"e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7","Type":"ContainerDied","Data":"32853355cae5602ac6a5daeeee86494aac6ead3cd6fb79861d90fc54faaaa751"} Jul 22 02:23:31.108100 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:31.108086 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf" event={"ID":"e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7","Type":"ContainerStarted","Data":"5e54e9783142521da927284a4e3e81b90f65f6b03f98217a8263916c9b622297"} Jul 22 02:23:31.109870 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:31.109847 2556 generic.go:356] "Generic (PLEG): container finished" podID="409f3291-97e8-4cd9-8e3a-20d37af25b62" containerID="b67f269da953aa1495383f299de3ea73c9aa025d2608cd694c4c26064db54d97" exitCode=0 Jul 22 02:23:31.109992 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:31.109888 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn" event={"ID":"409f3291-97e8-4cd9-8e3a-20d37af25b62","Type":"ContainerDied","Data":"b67f269da953aa1495383f299de3ea73c9aa025d2608cd694c4c26064db54d97"} Jul 22 02:23:31.109992 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:31.109923 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn" event={"ID":"409f3291-97e8-4cd9-8e3a-20d37af25b62","Type":"ContainerStarted","Data":"75e521d37f21a83320587882966f8170913abfde66e20b7e5c8abb4361ba5257"} Jul 22 02:23:31.124346 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:31.124324 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd"] Jul 22 02:23:31.127545 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:23:31.127522 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e2a6a0_502e_4149_bd20_e63882835f24.slice/crio-05b4915fdb94369495cb0664de84a69d6b2867f6ad689314799cd1df8149d125 WatchSource:0}: Error finding container 05b4915fdb94369495cb0664de84a69d6b2867f6ad689314799cd1df8149d125: Status 404 returned error can't find the container with id 05b4915fdb94369495cb0664de84a69d6b2867f6ad689314799cd1df8149d125 Jul 22 02:23:32.116545 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:32.116517 2556 generic.go:356] "Generic (PLEG): container finished" podID="e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7" containerID="a2c327cfaf9a74381e5e1a014f95a4f482ef2fd3749f502f9f9d5fe0727f9fe4" exitCode=0 Jul 22 02:23:32.116962 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:32.116562 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf" event={"ID":"e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7","Type":"ContainerDied","Data":"a2c327cfaf9a74381e5e1a014f95a4f482ef2fd3749f502f9f9d5fe0727f9fe4"} Jul 22 02:23:32.118182 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:32.118155 2556 generic.go:356] "Generic (PLEG): container finished" podID="f9e2a6a0-502e-4149-bd20-e63882835f24" containerID="33579838ea61c27a1c6b66f28af9a0b29885af46818a0061a1def84591c7130e" exitCode=0 Jul 22 02:23:32.118278 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:32.118220 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd" event={"ID":"f9e2a6a0-502e-4149-bd20-e63882835f24","Type":"ContainerDied","Data":"33579838ea61c27a1c6b66f28af9a0b29885af46818a0061a1def84591c7130e"} Jul 22 02:23:32.118278 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:32.118260 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd" event={"ID":"f9e2a6a0-502e-4149-bd20-e63882835f24","Type":"ContainerStarted","Data":"05b4915fdb94369495cb0664de84a69d6b2867f6ad689314799cd1df8149d125"} Jul 22 02:23:32.120276 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:32.120252 2556 generic.go:356] "Generic (PLEG): container finished" podID="409f3291-97e8-4cd9-8e3a-20d37af25b62" containerID="0b2070198e7f3e602aa04eb7283525c5ee2e7e005856397aca954417a4f6601a" exitCode=0 Jul 22 02:23:32.120400 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:32.120324 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn" event={"ID":"409f3291-97e8-4cd9-8e3a-20d37af25b62","Type":"ContainerDied","Data":"0b2070198e7f3e602aa04eb7283525c5ee2e7e005856397aca954417a4f6601a"} Jul 22 02:23:33.132617 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:33.132579 2556 generic.go:356] "Generic (PLEG): container finished" podID="869a4831-c73d-413b-94d1-f06ed4c19b23" containerID="1731f593102d163ec632f20725feff39bc1db52975b232069a0e75d7df12603c" exitCode=0 Jul 22 02:23:33.133037 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:33.132664 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m" event={"ID":"869a4831-c73d-413b-94d1-f06ed4c19b23","Type":"ContainerDied","Data":"1731f593102d163ec632f20725feff39bc1db52975b232069a0e75d7df12603c"} Jul 22 02:23:33.134973 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:33.134949 2556 generic.go:356] "Generic (PLEG): container finished" podID="e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7" containerID="80ceea9faf38afb456ab8efbff499d1e7e6ec67e529357b122c4d77d022666bf" exitCode=0 Jul 22 02:23:33.135085 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:33.135035 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf" event={"ID":"e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7","Type":"ContainerDied","Data":"80ceea9faf38afb456ab8efbff499d1e7e6ec67e529357b122c4d77d022666bf"} Jul 22 02:23:33.136573 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:33.136557 2556 generic.go:356] "Generic (PLEG): container finished" podID="f9e2a6a0-502e-4149-bd20-e63882835f24" containerID="0b4507645865966f214461644897466599e421c245e7d1cb6f144534b40fbae2" exitCode=0 Jul 22 02:23:33.136682 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:33.136659 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd" event={"ID":"f9e2a6a0-502e-4149-bd20-e63882835f24","Type":"ContainerDied","Data":"0b4507645865966f214461644897466599e421c245e7d1cb6f144534b40fbae2"} Jul 22 02:23:33.139129 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:33.139105 2556 generic.go:356] "Generic (PLEG): container finished" podID="409f3291-97e8-4cd9-8e3a-20d37af25b62" containerID="e7bd702e409ca9ea1f40a4d3cc53ce6517e76da40bc6eb308d7454c57cc430f9" exitCode=0 Jul 22 02:23:33.139223 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:33.139149 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn" event={"ID":"409f3291-97e8-4cd9-8e3a-20d37af25b62","Type":"ContainerDied","Data":"e7bd702e409ca9ea1f40a4d3cc53ce6517e76da40bc6eb308d7454c57cc430f9"} Jul 22 02:23:34.145674 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.145627 2556 generic.go:356] "Generic (PLEG): container finished" podID="f9e2a6a0-502e-4149-bd20-e63882835f24" containerID="d28b724539c2de2955daab068b7d2ed607c5626de702978a284b2ef920ce1141" exitCode=0 Jul 22 02:23:34.146040 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.145710 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd" event={"ID":"f9e2a6a0-502e-4149-bd20-e63882835f24","Type":"ContainerDied","Data":"d28b724539c2de2955daab068b7d2ed607c5626de702978a284b2ef920ce1141"} Jul 22 02:23:34.147785 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.147752 2556 generic.go:356] "Generic (PLEG): container finished" podID="869a4831-c73d-413b-94d1-f06ed4c19b23" containerID="f5a7db844cc5ea45696bcfc9ca88061ffd65e39f0cbb4765a3aacc26f9ab5626" exitCode=0 Jul 22 02:23:34.147912 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.147831 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m" event={"ID":"869a4831-c73d-413b-94d1-f06ed4c19b23","Type":"ContainerDied","Data":"f5a7db844cc5ea45696bcfc9ca88061ffd65e39f0cbb4765a3aacc26f9ab5626"} Jul 22 02:23:34.285903 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.285869 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf" Jul 22 02:23:34.313220 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.313196 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn" Jul 22 02:23:34.343314 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.343288 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7-bundle\") pod \"e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7\" (UID: \"e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7\") " Jul 22 02:23:34.343449 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.343328 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/409f3291-97e8-4cd9-8e3a-20d37af25b62-util\") pod \"409f3291-97e8-4cd9-8e3a-20d37af25b62\" (UID: \"409f3291-97e8-4cd9-8e3a-20d37af25b62\") " Jul 22 02:23:34.343449 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.343355 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7-util\") pod \"e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7\" (UID: \"e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7\") " Jul 22 02:23:34.343449 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.343388 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmwbx\" (UniqueName: \"kubernetes.io/projected/e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7-kube-api-access-rmwbx\") pod \"e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7\" (UID: \"e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7\") " Jul 22 02:23:34.343449 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.343406 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/409f3291-97e8-4cd9-8e3a-20d37af25b62-bundle\") pod \"409f3291-97e8-4cd9-8e3a-20d37af25b62\" (UID: \"409f3291-97e8-4cd9-8e3a-20d37af25b62\") " Jul 22 02:23:34.343449 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.343439 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfjdx\" (UniqueName: \"kubernetes.io/projected/409f3291-97e8-4cd9-8e3a-20d37af25b62-kube-api-access-sfjdx\") pod \"409f3291-97e8-4cd9-8e3a-20d37af25b62\" (UID: \"409f3291-97e8-4cd9-8e3a-20d37af25b62\") " Jul 22 02:23:34.344285 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.344240 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/409f3291-97e8-4cd9-8e3a-20d37af25b62-bundle" (OuterVolumeSpecName: "bundle") pod "409f3291-97e8-4cd9-8e3a-20d37af25b62" (UID: "409f3291-97e8-4cd9-8e3a-20d37af25b62"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:23:34.344285 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.344252 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7-bundle" (OuterVolumeSpecName: "bundle") pod "e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7" (UID: "e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:23:34.345997 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.345966 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7-kube-api-access-rmwbx" (OuterVolumeSpecName: "kube-api-access-rmwbx") pod "e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7" (UID: "e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7"). InnerVolumeSpecName "kube-api-access-rmwbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:23:34.346198 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.346165 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/409f3291-97e8-4cd9-8e3a-20d37af25b62-kube-api-access-sfjdx" (OuterVolumeSpecName: "kube-api-access-sfjdx") pod "409f3291-97e8-4cd9-8e3a-20d37af25b62" (UID: "409f3291-97e8-4cd9-8e3a-20d37af25b62"). InnerVolumeSpecName "kube-api-access-sfjdx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:23:34.352051 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.352026 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7-util" (OuterVolumeSpecName: "util") pod "e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7" (UID: "e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:23:34.352941 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.352915 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/409f3291-97e8-4cd9-8e3a-20d37af25b62-util" (OuterVolumeSpecName: "util") pod "409f3291-97e8-4cd9-8e3a-20d37af25b62" (UID: "409f3291-97e8-4cd9-8e3a-20d37af25b62"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:23:34.444896 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.444865 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmwbx\" (UniqueName: \"kubernetes.io/projected/e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7-kube-api-access-rmwbx\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:23:34.444896 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.444895 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/409f3291-97e8-4cd9-8e3a-20d37af25b62-bundle\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:23:34.445091 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.444906 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfjdx\" (UniqueName: \"kubernetes.io/projected/409f3291-97e8-4cd9-8e3a-20d37af25b62-kube-api-access-sfjdx\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:23:34.445091 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.444916 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7-bundle\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:23:34.445091 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.444923 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/409f3291-97e8-4cd9-8e3a-20d37af25b62-util\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:23:34.445091 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:34.444930 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7-util\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:23:35.154294 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.154265 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf" Jul 22 02:23:35.154778 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.154298 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf" event={"ID":"e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7","Type":"ContainerDied","Data":"5e54e9783142521da927284a4e3e81b90f65f6b03f98217a8263916c9b622297"} Jul 22 02:23:35.154778 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.154354 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e54e9783142521da927284a4e3e81b90f65f6b03f98217a8263916c9b622297" Jul 22 02:23:35.156231 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.156197 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn" event={"ID":"409f3291-97e8-4cd9-8e3a-20d37af25b62","Type":"ContainerDied","Data":"75e521d37f21a83320587882966f8170913abfde66e20b7e5c8abb4361ba5257"} Jul 22 02:23:35.156350 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.156245 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75e521d37f21a83320587882966f8170913abfde66e20b7e5c8abb4361ba5257" Jul 22 02:23:35.156409 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.156392 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn" Jul 22 02:23:35.286223 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.286199 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m" Jul 22 02:23:35.320375 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.320354 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd" Jul 22 02:23:35.351182 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.351155 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4d2l\" (UniqueName: \"kubernetes.io/projected/869a4831-c73d-413b-94d1-f06ed4c19b23-kube-api-access-l4d2l\") pod \"869a4831-c73d-413b-94d1-f06ed4c19b23\" (UID: \"869a4831-c73d-413b-94d1-f06ed4c19b23\") " Jul 22 02:23:35.351303 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.351188 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5nts\" (UniqueName: \"kubernetes.io/projected/f9e2a6a0-502e-4149-bd20-e63882835f24-kube-api-access-f5nts\") pod \"f9e2a6a0-502e-4149-bd20-e63882835f24\" (UID: \"f9e2a6a0-502e-4149-bd20-e63882835f24\") " Jul 22 02:23:35.351303 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.351216 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/869a4831-c73d-413b-94d1-f06ed4c19b23-util\") pod \"869a4831-c73d-413b-94d1-f06ed4c19b23\" (UID: \"869a4831-c73d-413b-94d1-f06ed4c19b23\") " Jul 22 02:23:35.351422 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.351346 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/869a4831-c73d-413b-94d1-f06ed4c19b23-bundle\") pod \"869a4831-c73d-413b-94d1-f06ed4c19b23\" (UID: \"869a4831-c73d-413b-94d1-f06ed4c19b23\") " Jul 22 02:23:35.351422 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.351400 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9e2a6a0-502e-4149-bd20-e63882835f24-util\") pod \"f9e2a6a0-502e-4149-bd20-e63882835f24\" (UID: \"f9e2a6a0-502e-4149-bd20-e63882835f24\") " Jul 22 02:23:35.351531 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.351448 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9e2a6a0-502e-4149-bd20-e63882835f24-bundle\") pod \"f9e2a6a0-502e-4149-bd20-e63882835f24\" (UID: \"f9e2a6a0-502e-4149-bd20-e63882835f24\") " Jul 22 02:23:35.351979 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.351898 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/869a4831-c73d-413b-94d1-f06ed4c19b23-bundle" (OuterVolumeSpecName: "bundle") pod "869a4831-c73d-413b-94d1-f06ed4c19b23" (UID: "869a4831-c73d-413b-94d1-f06ed4c19b23"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:23:35.352184 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.352160 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e2a6a0-502e-4149-bd20-e63882835f24-bundle" (OuterVolumeSpecName: "bundle") pod "f9e2a6a0-502e-4149-bd20-e63882835f24" (UID: "f9e2a6a0-502e-4149-bd20-e63882835f24"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:23:35.354126 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.354103 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e2a6a0-502e-4149-bd20-e63882835f24-kube-api-access-f5nts" (OuterVolumeSpecName: "kube-api-access-f5nts") pod "f9e2a6a0-502e-4149-bd20-e63882835f24" (UID: "f9e2a6a0-502e-4149-bd20-e63882835f24"). InnerVolumeSpecName "kube-api-access-f5nts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:23:35.355187 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.355154 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/869a4831-c73d-413b-94d1-f06ed4c19b23-kube-api-access-l4d2l" (OuterVolumeSpecName: "kube-api-access-l4d2l") pod "869a4831-c73d-413b-94d1-f06ed4c19b23" (UID: "869a4831-c73d-413b-94d1-f06ed4c19b23"). InnerVolumeSpecName "kube-api-access-l4d2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:23:35.357951 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.357922 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/869a4831-c73d-413b-94d1-f06ed4c19b23-util" (OuterVolumeSpecName: "util") pod "869a4831-c73d-413b-94d1-f06ed4c19b23" (UID: "869a4831-c73d-413b-94d1-f06ed4c19b23"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:23:35.360360 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.360309 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e2a6a0-502e-4149-bd20-e63882835f24-util" (OuterVolumeSpecName: "util") pod "f9e2a6a0-502e-4149-bd20-e63882835f24" (UID: "f9e2a6a0-502e-4149-bd20-e63882835f24"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:23:35.452902 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.452868 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/869a4831-c73d-413b-94d1-f06ed4c19b23-bundle\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:23:35.452902 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.452899 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9e2a6a0-502e-4149-bd20-e63882835f24-util\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:23:35.452902 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.452907 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9e2a6a0-502e-4149-bd20-e63882835f24-bundle\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:23:35.453130 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.452916 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4d2l\" (UniqueName: \"kubernetes.io/projected/869a4831-c73d-413b-94d1-f06ed4c19b23-kube-api-access-l4d2l\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:23:35.453130 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.452926 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5nts\" (UniqueName: \"kubernetes.io/projected/f9e2a6a0-502e-4149-bd20-e63882835f24-kube-api-access-f5nts\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:23:35.453130 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:35.452934 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/869a4831-c73d-413b-94d1-f06ed4c19b23-util\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:23:36.162292 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:36.162265 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m" Jul 22 02:23:36.162292 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:36.162275 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m" event={"ID":"869a4831-c73d-413b-94d1-f06ed4c19b23","Type":"ContainerDied","Data":"00040649faf734f98f7289a65a8daad99a1fe8c19faed6a3c04e814f299480d3"} Jul 22 02:23:36.162765 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:36.162321 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00040649faf734f98f7289a65a8daad99a1fe8c19faed6a3c04e814f299480d3" Jul 22 02:23:36.164123 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:36.164101 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd" Jul 22 02:23:36.164239 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:36.164126 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd" event={"ID":"f9e2a6a0-502e-4149-bd20-e63882835f24","Type":"ContainerDied","Data":"05b4915fdb94369495cb0664de84a69d6b2867f6ad689314799cd1df8149d125"} Jul 22 02:23:36.164239 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:23:36.164159 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05b4915fdb94369495cb0664de84a69d6b2867f6ad689314799cd1df8149d125" Jul 22 02:24:24.272841 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.272798 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-97cf44bf9-nc24q"] Jul 22 02:24:24.273251 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273233 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7" containerName="extract" Jul 22 02:24:24.273251 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273248 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7" containerName="extract" Jul 22 02:24:24.273321 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273260 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="409f3291-97e8-4cd9-8e3a-20d37af25b62" containerName="extract" Jul 22 02:24:24.273321 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273266 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="409f3291-97e8-4cd9-8e3a-20d37af25b62" containerName="extract" Jul 22 02:24:24.273321 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273275 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7" containerName="util" Jul 22 02:24:24.273321 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273284 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7" containerName="util" Jul 22 02:24:24.273321 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273294 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e2a6a0-502e-4149-bd20-e63882835f24" containerName="util" Jul 22 02:24:24.273321 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273304 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e2a6a0-502e-4149-bd20-e63882835f24" containerName="util" Jul 22 02:24:24.273321 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273313 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="409f3291-97e8-4cd9-8e3a-20d37af25b62" containerName="pull" Jul 22 02:24:24.273321 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273319 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="409f3291-97e8-4cd9-8e3a-20d37af25b62" containerName="pull" Jul 22 02:24:24.273544 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273325 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e2a6a0-502e-4149-bd20-e63882835f24" containerName="pull" Jul 22 02:24:24.273544 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273331 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e2a6a0-502e-4149-bd20-e63882835f24" containerName="pull" Jul 22 02:24:24.273544 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273340 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="409f3291-97e8-4cd9-8e3a-20d37af25b62" containerName="util" Jul 22 02:24:24.273544 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273345 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="409f3291-97e8-4cd9-8e3a-20d37af25b62" containerName="util" Jul 22 02:24:24.273544 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273352 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="869a4831-c73d-413b-94d1-f06ed4c19b23" containerName="util" Jul 22 02:24:24.273544 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273357 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="869a4831-c73d-413b-94d1-f06ed4c19b23" containerName="util" Jul 22 02:24:24.273544 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273367 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="869a4831-c73d-413b-94d1-f06ed4c19b23" containerName="pull" Jul 22 02:24:24.273544 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273373 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="869a4831-c73d-413b-94d1-f06ed4c19b23" containerName="pull" Jul 22 02:24:24.273544 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273379 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7" containerName="pull" Jul 22 02:24:24.273544 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273384 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7" containerName="pull" Jul 22 02:24:24.273544 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273395 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e2a6a0-502e-4149-bd20-e63882835f24" containerName="extract" Jul 22 02:24:24.273544 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273399 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e2a6a0-502e-4149-bd20-e63882835f24" containerName="extract" Jul 22 02:24:24.273544 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273406 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="869a4831-c73d-413b-94d1-f06ed4c19b23" containerName="extract" Jul 22 02:24:24.273544 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273414 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="869a4831-c73d-413b-94d1-f06ed4c19b23" containerName="extract" Jul 22 02:24:24.273544 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273469 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9e2a6a0-502e-4149-bd20-e63882835f24" containerName="extract" Jul 22 02:24:24.273544 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273477 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="409f3291-97e8-4cd9-8e3a-20d37af25b62" containerName="extract" Jul 22 02:24:24.273544 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273483 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="869a4831-c73d-413b-94d1-f06ed4c19b23" containerName="extract" Jul 22 02:24:24.273544 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.273490 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7" containerName="extract" Jul 22 02:24:24.276461 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.276441 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.296929 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.296897 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97cf44bf9-nc24q"] Jul 22 02:24:24.374367 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.374327 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c71f027-4f3f-418d-b644-0d513923c76c-console-serving-cert\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.374567 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.374457 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c71f027-4f3f-418d-b644-0d513923c76c-console-config\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.374567 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.374476 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmhxt\" (UniqueName: \"kubernetes.io/projected/6c71f027-4f3f-418d-b644-0d513923c76c-kube-api-access-mmhxt\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.374567 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.374517 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c71f027-4f3f-418d-b644-0d513923c76c-oauth-serving-cert\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.374732 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.374587 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c71f027-4f3f-418d-b644-0d513923c76c-console-oauth-config\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.374732 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.374626 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c71f027-4f3f-418d-b644-0d513923c76c-trusted-ca-bundle\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.374732 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.374692 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c71f027-4f3f-418d-b644-0d513923c76c-service-ca\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.475621 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.475581 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c71f027-4f3f-418d-b644-0d513923c76c-console-config\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.475621 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.475620 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmhxt\" (UniqueName: \"kubernetes.io/projected/6c71f027-4f3f-418d-b644-0d513923c76c-kube-api-access-mmhxt\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.475875 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.475673 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c71f027-4f3f-418d-b644-0d513923c76c-oauth-serving-cert\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.475875 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.475702 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c71f027-4f3f-418d-b644-0d513923c76c-console-oauth-config\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.475875 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.475719 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c71f027-4f3f-418d-b644-0d513923c76c-trusted-ca-bundle\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.475875 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.475738 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c71f027-4f3f-418d-b644-0d513923c76c-service-ca\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.475875 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.475823 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c71f027-4f3f-418d-b644-0d513923c76c-console-serving-cert\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.476481 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.476451 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c71f027-4f3f-418d-b644-0d513923c76c-oauth-serving-cert\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.476609 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.476451 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c71f027-4f3f-418d-b644-0d513923c76c-console-config\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.476609 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.476586 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c71f027-4f3f-418d-b644-0d513923c76c-trusted-ca-bundle\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.476609 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.476590 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c71f027-4f3f-418d-b644-0d513923c76c-service-ca\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.478251 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.478231 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c71f027-4f3f-418d-b644-0d513923c76c-console-serving-cert\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.478385 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.478363 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c71f027-4f3f-418d-b644-0d513923c76c-console-oauth-config\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.487750 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.487729 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmhxt\" (UniqueName: \"kubernetes.io/projected/6c71f027-4f3f-418d-b644-0d513923c76c-kube-api-access-mmhxt\") pod \"console-97cf44bf9-nc24q\" (UID: \"6c71f027-4f3f-418d-b644-0d513923c76c\") " pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.585691 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.585577 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:24.724601 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:24.724572 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97cf44bf9-nc24q"] Jul 22 02:24:24.726503 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:24:24.726473 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c71f027_4f3f_418d_b644_0d513923c76c.slice/crio-dc5af76f4ec8449e42839c5b6d03fa5f58586a822d8c9ec930b5917688ff21a3 WatchSource:0}: Error finding container dc5af76f4ec8449e42839c5b6d03fa5f58586a822d8c9ec930b5917688ff21a3: Status 404 returned error can't find the container with id dc5af76f4ec8449e42839c5b6d03fa5f58586a822d8c9ec930b5917688ff21a3 Jul 22 02:24:25.404486 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:25.404450 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97cf44bf9-nc24q" event={"ID":"6c71f027-4f3f-418d-b644-0d513923c76c","Type":"ContainerStarted","Data":"34d7b0d63402d1d8423a2ae52b41c2c39a2bf5680edf4a89d4505fb6f0d0d592"} Jul 22 02:24:25.404887 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:25.404500 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97cf44bf9-nc24q" event={"ID":"6c71f027-4f3f-418d-b644-0d513923c76c","Type":"ContainerStarted","Data":"dc5af76f4ec8449e42839c5b6d03fa5f58586a822d8c9ec930b5917688ff21a3"} Jul 22 02:24:25.427236 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:25.427183 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-97cf44bf9-nc24q" podStartSLOduration=1.427166012 podStartE2EDuration="1.427166012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:24:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:24:25.424546582 +0000 UTC m=+466.532965917" watchObservedRunningTime="2026-07-22 02:24:25.427166012 +0000 UTC m=+466.535585348" Jul 22 02:24:34.585989 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:34.585953 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:34.586373 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:34.586013 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:34.590339 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:34.590319 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:35.457973 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:35.457945 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-97cf44bf9-nc24q" Jul 22 02:24:35.518741 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:35.518704 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59cf5ffc87-299gm"] Jul 22 02:24:55.780484 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.780454 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck"] Jul 22 02:24:55.784152 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.784133 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.787965 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.787943 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ctmjk\"" Jul 22 02:24:55.800589 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.800561 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck"] Jul 22 02:24:55.859073 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.859037 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e35f816c-eba3-47ae-a9aa-a18ae53c426f-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.859073 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.859066 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e35f816c-eba3-47ae-a9aa-a18ae53c426f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.859338 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.859085 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls6ct\" (UniqueName: \"kubernetes.io/projected/e35f816c-eba3-47ae-a9aa-a18ae53c426f-kube-api-access-ls6ct\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.859338 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.859105 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e35f816c-eba3-47ae-a9aa-a18ae53c426f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.859338 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.859180 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e35f816c-eba3-47ae-a9aa-a18ae53c426f-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.859338 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.859245 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e35f816c-eba3-47ae-a9aa-a18ae53c426f-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.859338 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.859297 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e35f816c-eba3-47ae-a9aa-a18ae53c426f-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.859338 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.859316 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e35f816c-eba3-47ae-a9aa-a18ae53c426f-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.859689 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.859351 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e35f816c-eba3-47ae-a9aa-a18ae53c426f-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.959809 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.959764 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e35f816c-eba3-47ae-a9aa-a18ae53c426f-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.959809 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.959810 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e35f816c-eba3-47ae-a9aa-a18ae53c426f-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.960061 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.959836 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e35f816c-eba3-47ae-a9aa-a18ae53c426f-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.960061 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.959873 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e35f816c-eba3-47ae-a9aa-a18ae53c426f-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.960061 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.959888 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e35f816c-eba3-47ae-a9aa-a18ae53c426f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.960061 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.959905 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls6ct\" (UniqueName: \"kubernetes.io/projected/e35f816c-eba3-47ae-a9aa-a18ae53c426f-kube-api-access-ls6ct\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.960061 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.959925 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e35f816c-eba3-47ae-a9aa-a18ae53c426f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.960061 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.959964 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e35f816c-eba3-47ae-a9aa-a18ae53c426f-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.960061 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.960021 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e35f816c-eba3-47ae-a9aa-a18ae53c426f-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.960448 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.960244 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e35f816c-eba3-47ae-a9aa-a18ae53c426f-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.960448 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.960278 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e35f816c-eba3-47ae-a9aa-a18ae53c426f-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.960555 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.960446 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e35f816c-eba3-47ae-a9aa-a18ae53c426f-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.960555 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.960485 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e35f816c-eba3-47ae-a9aa-a18ae53c426f-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.960688 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.960664 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e35f816c-eba3-47ae-a9aa-a18ae53c426f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.962296 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.962261 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e35f816c-eba3-47ae-a9aa-a18ae53c426f-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.962445 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.962424 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e35f816c-eba3-47ae-a9aa-a18ae53c426f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.969546 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.969522 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e35f816c-eba3-47ae-a9aa-a18ae53c426f-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:55.969689 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:55.969624 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls6ct\" (UniqueName: \"kubernetes.io/projected/e35f816c-eba3-47ae-a9aa-a18ae53c426f-kube-api-access-ls6ct\") pod \"maas-default-gateway-openshift-default-56654dcf7-whzck\" (UID: \"e35f816c-eba3-47ae-a9aa-a18ae53c426f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:56.093989 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:56.093902 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:56.241425 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:56.241400 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck"] Jul 22 02:24:56.243514 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:24:56.243487 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode35f816c_eba3_47ae_a9aa_a18ae53c426f.slice/crio-c235725dfc3cb25e7f313bd06b51affc740bdb4609aa3704b5c6c2e56279f4a3 WatchSource:0}: Error finding container c235725dfc3cb25e7f313bd06b51affc740bdb4609aa3704b5c6c2e56279f4a3: Status 404 returned error can't find the container with id c235725dfc3cb25e7f313bd06b51affc740bdb4609aa3704b5c6c2e56279f4a3 Jul 22 02:24:56.245573 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:56.245512 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:24:56.245656 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:56.245608 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:24:56.245702 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:56.245662 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:24:56.554657 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:56.554601 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" event={"ID":"e35f816c-eba3-47ae-a9aa-a18ae53c426f","Type":"ContainerStarted","Data":"41baeeb62dc56158e1a7424931ce2e18000277dfbd529e746f489364716b5b92"} Jul 22 02:24:56.554866 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:56.554691 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" event={"ID":"e35f816c-eba3-47ae-a9aa-a18ae53c426f","Type":"ContainerStarted","Data":"c235725dfc3cb25e7f313bd06b51affc740bdb4609aa3704b5c6c2e56279f4a3"} Jul 22 02:24:56.577167 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:56.577106 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" podStartSLOduration=1.577089011 podStartE2EDuration="1.577089011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:24:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:24:56.575158518 +0000 UTC m=+497.683577854" watchObservedRunningTime="2026-07-22 02:24:56.577089011 +0000 UTC m=+497.685508347" Jul 22 02:24:57.094217 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:57.094182 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:57.099068 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:57.099045 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:57.559398 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:57.559369 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:24:57.560380 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:24:57.560355 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:25:00.539995 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.539954 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59cf5ffc87-299gm" podUID="4478784f-fe2d-4b2e-8679-acd857188038" containerName="console" containerID="cri-o://8c29735ba8779b5e27448d029a51fbc6d5be2750f3ee38cdbab04f51806b3c5d" gracePeriod=15 Jul 22 02:25:00.795437 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.795372 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:25:00.896789 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.896748 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-console-config\") pod \"4478784f-fe2d-4b2e-8679-acd857188038\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " Jul 22 02:25:00.896789 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.896797 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-oauth-serving-cert\") pod \"4478784f-fe2d-4b2e-8679-acd857188038\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " Jul 22 02:25:00.897024 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.896822 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4478784f-fe2d-4b2e-8679-acd857188038-console-oauth-config\") pod \"4478784f-fe2d-4b2e-8679-acd857188038\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " Jul 22 02:25:00.897024 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.896848 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zspp\" (UniqueName: \"kubernetes.io/projected/4478784f-fe2d-4b2e-8679-acd857188038-kube-api-access-5zspp\") pod \"4478784f-fe2d-4b2e-8679-acd857188038\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " Jul 22 02:25:00.897024 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.896865 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-trusted-ca-bundle\") pod \"4478784f-fe2d-4b2e-8679-acd857188038\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " Jul 22 02:25:00.897024 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.896885 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-service-ca\") pod \"4478784f-fe2d-4b2e-8679-acd857188038\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " Jul 22 02:25:00.897024 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.896901 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4478784f-fe2d-4b2e-8679-acd857188038-console-serving-cert\") pod \"4478784f-fe2d-4b2e-8679-acd857188038\" (UID: \"4478784f-fe2d-4b2e-8679-acd857188038\") " Jul 22 02:25:00.897262 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.897209 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-console-config" (OuterVolumeSpecName: "console-config") pod "4478784f-fe2d-4b2e-8679-acd857188038" (UID: "4478784f-fe2d-4b2e-8679-acd857188038"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:25:00.897434 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.897403 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4478784f-fe2d-4b2e-8679-acd857188038" (UID: "4478784f-fe2d-4b2e-8679-acd857188038"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:25:00.897434 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.897409 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-service-ca" (OuterVolumeSpecName: "service-ca") pod "4478784f-fe2d-4b2e-8679-acd857188038" (UID: "4478784f-fe2d-4b2e-8679-acd857188038"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:25:00.897589 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.897448 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4478784f-fe2d-4b2e-8679-acd857188038" (UID: "4478784f-fe2d-4b2e-8679-acd857188038"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:25:00.899113 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.899090 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4478784f-fe2d-4b2e-8679-acd857188038-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4478784f-fe2d-4b2e-8679-acd857188038" (UID: "4478784f-fe2d-4b2e-8679-acd857188038"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:25:00.899216 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.899111 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4478784f-fe2d-4b2e-8679-acd857188038-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4478784f-fe2d-4b2e-8679-acd857188038" (UID: "4478784f-fe2d-4b2e-8679-acd857188038"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:25:00.899265 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.899207 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4478784f-fe2d-4b2e-8679-acd857188038-kube-api-access-5zspp" (OuterVolumeSpecName: "kube-api-access-5zspp") pod "4478784f-fe2d-4b2e-8679-acd857188038" (UID: "4478784f-fe2d-4b2e-8679-acd857188038"). InnerVolumeSpecName "kube-api-access-5zspp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:25:00.997697 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.997664 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-console-config\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:25:00.997697 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.997695 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-oauth-serving-cert\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:25:00.997697 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.997708 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4478784f-fe2d-4b2e-8679-acd857188038-console-oauth-config\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:25:00.997937 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.997721 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zspp\" (UniqueName: \"kubernetes.io/projected/4478784f-fe2d-4b2e-8679-acd857188038-kube-api-access-5zspp\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:25:00.997937 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.997733 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-trusted-ca-bundle\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:25:00.997937 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.997746 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4478784f-fe2d-4b2e-8679-acd857188038-service-ca\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:25:00.997937 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:00.997757 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4478784f-fe2d-4b2e-8679-acd857188038-console-serving-cert\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:25:01.588373 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:01.588339 2556 generic.go:356] "Generic (PLEG): container finished" podID="4478784f-fe2d-4b2e-8679-acd857188038" containerID="8c29735ba8779b5e27448d029a51fbc6d5be2750f3ee38cdbab04f51806b3c5d" exitCode=0 Jul 22 02:25:01.588901 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:01.588387 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cf5ffc87-299gm" event={"ID":"4478784f-fe2d-4b2e-8679-acd857188038","Type":"ContainerDied","Data":"8c29735ba8779b5e27448d029a51fbc6d5be2750f3ee38cdbab04f51806b3c5d"} Jul 22 02:25:01.588901 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:01.588405 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cf5ffc87-299gm" Jul 22 02:25:01.588901 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:01.588451 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cf5ffc87-299gm" event={"ID":"4478784f-fe2d-4b2e-8679-acd857188038","Type":"ContainerDied","Data":"3e9c847c58014781372a441fd0ceec9d1a40d537dda5086e80ce12e1f93d0d13"} Jul 22 02:25:01.588901 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:01.588472 2556 scope.go:117] "RemoveContainer" containerID="8c29735ba8779b5e27448d029a51fbc6d5be2750f3ee38cdbab04f51806b3c5d" Jul 22 02:25:01.597188 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:01.597171 2556 scope.go:117] "RemoveContainer" containerID="8c29735ba8779b5e27448d029a51fbc6d5be2750f3ee38cdbab04f51806b3c5d" Jul 22 02:25:01.597487 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:25:01.597470 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c29735ba8779b5e27448d029a51fbc6d5be2750f3ee38cdbab04f51806b3c5d\": container with ID starting with 8c29735ba8779b5e27448d029a51fbc6d5be2750f3ee38cdbab04f51806b3c5d not found: ID does not exist" containerID="8c29735ba8779b5e27448d029a51fbc6d5be2750f3ee38cdbab04f51806b3c5d" Jul 22 02:25:01.597536 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:01.597495 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c29735ba8779b5e27448d029a51fbc6d5be2750f3ee38cdbab04f51806b3c5d"} err="failed to get container status \"8c29735ba8779b5e27448d029a51fbc6d5be2750f3ee38cdbab04f51806b3c5d\": rpc error: code = NotFound desc = could not find container \"8c29735ba8779b5e27448d029a51fbc6d5be2750f3ee38cdbab04f51806b3c5d\": container with ID starting with 8c29735ba8779b5e27448d029a51fbc6d5be2750f3ee38cdbab04f51806b3c5d not found: ID does not exist" Jul 22 02:25:01.610412 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:01.610384 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59cf5ffc87-299gm"] Jul 22 02:25:01.616805 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:01.616777 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59cf5ffc87-299gm"] Jul 22 02:25:02.253855 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:25:02.253827 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4478784f-fe2d-4b2e-8679-acd857188038" path="/var/lib/kubelet/pods/4478784f-fe2d-4b2e-8679-acd857188038/volumes" Jul 22 02:26:15.927056 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:15.927020 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-vcbtq"] Jul 22 02:26:15.927571 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:15.927355 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4478784f-fe2d-4b2e-8679-acd857188038" containerName="console" Jul 22 02:26:15.927571 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:15.927366 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4478784f-fe2d-4b2e-8679-acd857188038" containerName="console" Jul 22 02:26:15.927571 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:15.927427 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4478784f-fe2d-4b2e-8679-acd857188038" containerName="console" Jul 22 02:26:15.930215 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:15.930198 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-vcbtq" Jul 22 02:26:15.934694 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:15.934668 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 22 02:26:15.955737 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:15.955707 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-vcbtq"] Jul 22 02:26:16.036195 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:16.036154 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5458b09-d09b-4ca7-aded-e3b09516d9b7-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-vcbtq\" (UID: \"d5458b09-d09b-4ca7-aded-e3b09516d9b7\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vcbtq" Jul 22 02:26:16.036375 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:16.036213 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxbl4\" (UniqueName: \"kubernetes.io/projected/d5458b09-d09b-4ca7-aded-e3b09516d9b7-kube-api-access-dxbl4\") pod \"payload-pre-processing-7677b774bb-vcbtq\" (UID: \"d5458b09-d09b-4ca7-aded-e3b09516d9b7\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vcbtq" Jul 22 02:26:16.137571 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:16.137533 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5458b09-d09b-4ca7-aded-e3b09516d9b7-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-vcbtq\" (UID: \"d5458b09-d09b-4ca7-aded-e3b09516d9b7\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vcbtq" Jul 22 02:26:16.137794 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:16.137600 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxbl4\" (UniqueName: \"kubernetes.io/projected/d5458b09-d09b-4ca7-aded-e3b09516d9b7-kube-api-access-dxbl4\") pod \"payload-pre-processing-7677b774bb-vcbtq\" (UID: \"d5458b09-d09b-4ca7-aded-e3b09516d9b7\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vcbtq" Jul 22 02:26:16.138340 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:16.138314 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5458b09-d09b-4ca7-aded-e3b09516d9b7-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-vcbtq\" (UID: \"d5458b09-d09b-4ca7-aded-e3b09516d9b7\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vcbtq" Jul 22 02:26:16.176262 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:16.176228 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxbl4\" (UniqueName: \"kubernetes.io/projected/d5458b09-d09b-4ca7-aded-e3b09516d9b7-kube-api-access-dxbl4\") pod \"payload-pre-processing-7677b774bb-vcbtq\" (UID: \"d5458b09-d09b-4ca7-aded-e3b09516d9b7\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vcbtq" Jul 22 02:26:16.240231 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:16.240143 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-vcbtq" Jul 22 02:26:16.411141 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:16.411086 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-vcbtq"] Jul 22 02:26:16.962001 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:16.961952 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-vcbtq" event={"ID":"d5458b09-d09b-4ca7-aded-e3b09516d9b7","Type":"ContainerStarted","Data":"ec6aab7707115b7a1dc3fa9fc752282b0afb727806168e61107b8053a1a330d8"} Jul 22 02:26:18.976031 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:18.975994 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-vcbtq" event={"ID":"d5458b09-d09b-4ca7-aded-e3b09516d9b7","Type":"ContainerStarted","Data":"d962da419e644d41f8a32dda9aedd9fb7252a23d04a8e84c0c21b53ac921725a"} Jul 22 02:26:18.976405 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:18.976156 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-vcbtq" Jul 22 02:26:19.012732 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:19.012670 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-vcbtq" podStartSLOduration=2.180628976 podStartE2EDuration="4.012628448s" totalImagesPullingTime="1.831999472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:26:19.010728615 +0000 UTC m=+580.119147950" watchObservedRunningTime="2026-07-22 02:26:19.012628448 +0000 UTC m=+580.121047785" Jul 22 02:26:24.003948 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:24.003911 2556 generic.go:356] "Generic (PLEG): container finished" podID="e35f816c-eba3-47ae-a9aa-a18ae53c426f" containerID="41baeeb62dc56158e1a7424931ce2e18000277dfbd529e746f489364716b5b92" exitCode=0 Jul 22 02:26:24.004482 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:24.003993 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" event={"ID":"e35f816c-eba3-47ae-a9aa-a18ae53c426f","Type":"ContainerDied","Data":"41baeeb62dc56158e1a7424931ce2e18000277dfbd529e746f489364716b5b92"} Jul 22 02:26:24.004555 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:24.004532 2556 scope.go:117] "RemoveContainer" containerID="41baeeb62dc56158e1a7424931ce2e18000277dfbd529e746f489364716b5b92" Jul 22 02:26:24.005566 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:24.005538 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:26:24.005633 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:24.005606 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:26:24.005687 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:24.005655 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:26:25.011359 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:25.011321 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" event={"ID":"e35f816c-eba3-47ae-a9aa-a18ae53c426f","Type":"ContainerStarted","Data":"44311ff5142945345927ef33af7d40be08821822e80a6562ff79bd0b769ea666"} Jul 22 02:26:25.094607 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:25.094565 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:26:25.095573 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:25.095551 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-whzck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 22 02:26:25.095632 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:25.095609 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" podUID="e35f816c-eba3-47ae-a9aa-a18ae53c426f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 22 02:26:26.094939 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:26.094903 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-whzck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 22 02:26:26.095325 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:26.094959 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" podUID="e35f816c-eba3-47ae-a9aa-a18ae53c426f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 22 02:26:27.094784 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:27.094746 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-whzck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 22 02:26:27.094949 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:27.094802 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" podUID="e35f816c-eba3-47ae-a9aa-a18ae53c426f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 22 02:26:27.559268 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:27.559228 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:26:28.094327 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:28.094291 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-whzck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 22 02:26:28.094528 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:28.094350 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" podUID="e35f816c-eba3-47ae-a9aa-a18ae53c426f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 22 02:26:29.120169 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:29.120139 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:26:29.121236 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:29.121213 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-whzck" Jul 22 02:26:29.982851 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:29.982818 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-vcbtq" Jul 22 02:26:32.558624 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.556174 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8"] Jul 22 02:26:32.560632 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.560607 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:32.566103 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.566008 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 22 02:26:32.567393 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.567318 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 22 02:26:32.567463 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.567394 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rs444\"" Jul 22 02:26:32.567557 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.567539 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 22 02:26:32.579933 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.579906 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8"] Jul 22 02:26:32.715449 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.715416 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rggn\" (UniqueName: \"kubernetes.io/projected/58068ab8-84c5-40c7-a8cf-9b808e6b9b58-kube-api-access-2rggn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8\" (UID: \"58068ab8-84c5-40c7-a8cf-9b808e6b9b58\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:32.715449 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.715454 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58068ab8-84c5-40c7-a8cf-9b808e6b9b58-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8\" (UID: \"58068ab8-84c5-40c7-a8cf-9b808e6b9b58\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:32.715715 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.715473 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58068ab8-84c5-40c7-a8cf-9b808e6b9b58-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8\" (UID: \"58068ab8-84c5-40c7-a8cf-9b808e6b9b58\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:32.715715 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.715496 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58068ab8-84c5-40c7-a8cf-9b808e6b9b58-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8\" (UID: \"58068ab8-84c5-40c7-a8cf-9b808e6b9b58\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:32.715715 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.715564 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58068ab8-84c5-40c7-a8cf-9b808e6b9b58-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8\" (UID: \"58068ab8-84c5-40c7-a8cf-9b808e6b9b58\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:32.715715 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.715676 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58068ab8-84c5-40c7-a8cf-9b808e6b9b58-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8\" (UID: \"58068ab8-84c5-40c7-a8cf-9b808e6b9b58\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:32.816829 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.816726 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rggn\" (UniqueName: \"kubernetes.io/projected/58068ab8-84c5-40c7-a8cf-9b808e6b9b58-kube-api-access-2rggn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8\" (UID: \"58068ab8-84c5-40c7-a8cf-9b808e6b9b58\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:32.816829 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.816783 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58068ab8-84c5-40c7-a8cf-9b808e6b9b58-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8\" (UID: \"58068ab8-84c5-40c7-a8cf-9b808e6b9b58\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:32.816829 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.816802 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58068ab8-84c5-40c7-a8cf-9b808e6b9b58-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8\" (UID: \"58068ab8-84c5-40c7-a8cf-9b808e6b9b58\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:32.816829 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.816826 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58068ab8-84c5-40c7-a8cf-9b808e6b9b58-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8\" (UID: \"58068ab8-84c5-40c7-a8cf-9b808e6b9b58\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:32.817151 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.816847 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58068ab8-84c5-40c7-a8cf-9b808e6b9b58-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8\" (UID: \"58068ab8-84c5-40c7-a8cf-9b808e6b9b58\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:32.817151 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.816884 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58068ab8-84c5-40c7-a8cf-9b808e6b9b58-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8\" (UID: \"58068ab8-84c5-40c7-a8cf-9b808e6b9b58\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:32.817257 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.817231 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58068ab8-84c5-40c7-a8cf-9b808e6b9b58-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8\" (UID: \"58068ab8-84c5-40c7-a8cf-9b808e6b9b58\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:32.817311 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.817281 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58068ab8-84c5-40c7-a8cf-9b808e6b9b58-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8\" (UID: \"58068ab8-84c5-40c7-a8cf-9b808e6b9b58\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:32.817311 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.817292 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58068ab8-84c5-40c7-a8cf-9b808e6b9b58-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8\" (UID: \"58068ab8-84c5-40c7-a8cf-9b808e6b9b58\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:32.819179 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.819155 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58068ab8-84c5-40c7-a8cf-9b808e6b9b58-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8\" (UID: \"58068ab8-84c5-40c7-a8cf-9b808e6b9b58\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:32.819389 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.819369 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58068ab8-84c5-40c7-a8cf-9b808e6b9b58-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8\" (UID: \"58068ab8-84c5-40c7-a8cf-9b808e6b9b58\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:32.835793 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.835772 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rggn\" (UniqueName: \"kubernetes.io/projected/58068ab8-84c5-40c7-a8cf-9b808e6b9b58-kube-api-access-2rggn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8\" (UID: \"58068ab8-84c5-40c7-a8cf-9b808e6b9b58\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:32.870703 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:32.870669 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:33.027369 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:26:33.027308 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58068ab8_84c5_40c7_a8cf_9b808e6b9b58.slice/crio-3248a866cc9491dcb53326531b284f16eb98364f940069ce416263ce1fd91a4d WatchSource:0}: Error finding container 3248a866cc9491dcb53326531b284f16eb98364f940069ce416263ce1fd91a4d: Status 404 returned error can't find the container with id 3248a866cc9491dcb53326531b284f16eb98364f940069ce416263ce1fd91a4d Jul 22 02:26:33.028126 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:33.028100 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8"] Jul 22 02:26:33.052394 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:33.052365 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" event={"ID":"58068ab8-84c5-40c7-a8cf-9b808e6b9b58","Type":"ContainerStarted","Data":"3248a866cc9491dcb53326531b284f16eb98364f940069ce416263ce1fd91a4d"} Jul 22 02:26:35.067261 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:35.067225 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" event={"ID":"58068ab8-84c5-40c7-a8cf-9b808e6b9b58","Type":"ContainerStarted","Data":"58413f6f28ea6073dcfdcefdecfb6cbff6c4519e78b5158ba57e6bc89545ae7a"} Jul 22 02:26:35.093491 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:35.093437 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" podStartSLOduration=1.970623764 podStartE2EDuration="3.093419517s" totalImagesPullingTime="1.122795753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:26:35.090756037 +0000 UTC m=+596.199175372" watchObservedRunningTime="2026-07-22 02:26:35.093419517 +0000 UTC m=+596.201838870" Jul 22 02:26:42.870949 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:42.870896 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:42.871394 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:42.870971 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:42.883612 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:42.883582 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:26:43.117929 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:26:43.117902 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8" Jul 22 02:30:00.155427 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:30:00.155389 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744790-27xlc"] Jul 22 02:30:00.157699 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:30:00.157681 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744790-27xlc" Jul 22 02:30:00.160803 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:30:00.160772 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rt9zm\"" Jul 22 02:30:00.167498 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:30:00.167479 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744790-27xlc" Jul 22 02:30:00.173864 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:30:00.173845 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744790-27xlc"] Jul 22 02:30:00.304103 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:30:00.304077 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744790-27xlc"] Jul 22 02:30:00.306100 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:30:00.306075 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaafddb28_2ba3_4afe_9d50_cd141e00c5b7.slice/crio-5b9fd046ba6389896786ac49361e4131cb9f40cc3243bfac55d67b572d2a38c6 WatchSource:0}: Error finding container 5b9fd046ba6389896786ac49361e4131cb9f40cc3243bfac55d67b572d2a38c6: Status 404 returned error can't find the container with id 5b9fd046ba6389896786ac49361e4131cb9f40cc3243bfac55d67b572d2a38c6 Jul 22 02:30:00.308057 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:30:00.308035 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 02:30:01.103093 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:30:01.103007 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744790-27xlc" event={"ID":"aafddb28-2ba3-4afe-9d50-cd141e00c5b7","Type":"ContainerStarted","Data":"5b9fd046ba6389896786ac49361e4131cb9f40cc3243bfac55d67b572d2a38c6"} Jul 22 02:30:04.122143 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:30:04.122091 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744790-27xlc" event={"ID":"aafddb28-2ba3-4afe-9d50-cd141e00c5b7","Type":"ContainerStarted","Data":"2ce5629483992a556c27f721e4178dee6a3043762b358ec17a20bd1ad54b3a1f"} Jul 22 02:30:04.139787 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:30:04.139732 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744790-27xlc" podStartSLOduration=1.053389219 podStartE2EDuration="4.139713897s" totalImagesPullingTime="3.086324678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:30:04.138732786 +0000 UTC m=+805.247152131" watchObservedRunningTime="2026-07-22 02:30:04.139713897 +0000 UTC m=+805.248133232" Jul 22 02:30:05.129680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:30:05.129626 2556 generic.go:356] "Generic (PLEG): container finished" podID="aafddb28-2ba3-4afe-9d50-cd141e00c5b7" containerID="2ce5629483992a556c27f721e4178dee6a3043762b358ec17a20bd1ad54b3a1f" exitCode=0 Jul 22 02:30:05.129680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:30:05.129687 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744790-27xlc" event={"ID":"aafddb28-2ba3-4afe-9d50-cd141e00c5b7","Type":"ContainerDied","Data":"2ce5629483992a556c27f721e4178dee6a3043762b358ec17a20bd1ad54b3a1f"} Jul 22 02:30:06.271144 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:30:06.271120 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744790-27xlc" Jul 22 02:30:07.141202 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:30:07.141163 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744790-27xlc" Jul 22 02:30:07.141401 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:30:07.141222 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744790-27xlc" event={"ID":"aafddb28-2ba3-4afe-9d50-cd141e00c5b7","Type":"ContainerDied","Data":"5b9fd046ba6389896786ac49361e4131cb9f40cc3243bfac55d67b572d2a38c6"} Jul 22 02:30:07.141401 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:30:07.141271 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b9fd046ba6389896786ac49361e4131cb9f40cc3243bfac55d67b572d2a38c6" Jul 22 02:39:11.204482 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.204436 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz"] Jul 22 02:39:11.204982 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.204847 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aafddb28-2ba3-4afe-9d50-cd141e00c5b7" containerName="cleanup" Jul 22 02:39:11.204982 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.204864 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="aafddb28-2ba3-4afe-9d50-cd141e00c5b7" containerName="cleanup" Jul 22 02:39:11.204982 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.204935 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="aafddb28-2ba3-4afe-9d50-cd141e00c5b7" containerName="cleanup" Jul 22 02:39:11.208029 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.208012 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:11.211003 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.210977 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-c5afd956-kserve-self-signed-certs\"" Jul 22 02:39:11.219144 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.219120 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz"] Jul 22 02:39:11.261040 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.260997 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-home\") pod \"e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:11.261204 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.261043 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93bd8f46-bd09-47b6-b5e2-2617bba86164-tls-certs\") pod \"e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:11.261204 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.261135 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-tmp-dir\") pod \"e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:11.261204 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.261184 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-model-cache\") pod \"e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:11.261312 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.261209 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnzhv\" (UniqueName: \"kubernetes.io/projected/93bd8f46-bd09-47b6-b5e2-2617bba86164-kube-api-access-dnzhv\") pod \"e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:11.261312 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.261280 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-dshm\") pod \"e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:11.362046 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.362001 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-home\") pod \"e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:11.362046 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.362050 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93bd8f46-bd09-47b6-b5e2-2617bba86164-tls-certs\") pod \"e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:11.362259 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.362241 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-tmp-dir\") pod \"e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:11.362294 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.362273 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-model-cache\") pod \"e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:11.362328 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.362301 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnzhv\" (UniqueName: \"kubernetes.io/projected/93bd8f46-bd09-47b6-b5e2-2617bba86164-kube-api-access-dnzhv\") pod \"e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:11.362371 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.362361 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-dshm\") pod \"e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:11.362444 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.362420 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-home\") pod \"e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:11.362621 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.362600 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-tmp-dir\") pod \"e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:11.362736 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.362601 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-model-cache\") pod \"e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:11.364462 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.364438 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-dshm\") pod \"e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:11.364757 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.364739 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93bd8f46-bd09-47b6-b5e2-2617bba86164-tls-certs\") pod \"e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:11.370954 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.370929 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnzhv\" (UniqueName: \"kubernetes.io/projected/93bd8f46-bd09-47b6-b5e2-2617bba86164-kube-api-access-dnzhv\") pod \"e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:11.516940 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.516848 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:11.656362 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.656331 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz"] Jul 22 02:39:11.657287 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:39:11.657255 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93bd8f46_bd09_47b6_b5e2_2617bba86164.slice/crio-3ccfcecf9e3f2610af087a84a870cc2e96e003b9071a18fe134dc97b63e11e31 WatchSource:0}: Error finding container 3ccfcecf9e3f2610af087a84a870cc2e96e003b9071a18fe134dc97b63e11e31: Status 404 returned error can't find the container with id 3ccfcecf9e3f2610af087a84a870cc2e96e003b9071a18fe134dc97b63e11e31 Jul 22 02:39:11.933568 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.933537 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" event={"ID":"93bd8f46-bd09-47b6-b5e2-2617bba86164","Type":"ContainerStarted","Data":"f11d50555c0fd9a02169c11a97b4c6ca1bff3cf28e8c2cc9739746c360981c7c"} Jul 22 02:39:11.933777 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.933576 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" event={"ID":"93bd8f46-bd09-47b6-b5e2-2617bba86164","Type":"ContainerStarted","Data":"3ccfcecf9e3f2610af087a84a870cc2e96e003b9071a18fe134dc97b63e11e31"} Jul 22 02:39:11.953516 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:11.953467 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" podStartSLOduration=0.953451134 podStartE2EDuration="953.451134ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:39:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:39:11.951769046 +0000 UTC m=+1353.060188383" watchObservedRunningTime="2026-07-22 02:39:11.953451134 +0000 UTC m=+1353.061870470" Jul 22 02:39:21.517717 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:21.517666 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:21.517717 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:21.517725 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:21.530225 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:21.530190 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:21.999272 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:21.999229 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:39:59.523300 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:39:59.523268 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz"] Jul 22 02:40:14.543081 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:14.543011 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" podUID="93bd8f46-bd09-47b6-b5e2-2617bba86164" containerName="main" containerID="cri-o://f11d50555c0fd9a02169c11a97b4c6ca1bff3cf28e8c2cc9739746c360981c7c" gracePeriod=45 Jul 22 02:40:14.798298 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:14.798228 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:40:14.930703 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:14.930668 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-home\") pod \"93bd8f46-bd09-47b6-b5e2-2617bba86164\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " Jul 22 02:40:14.930866 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:14.930722 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-dshm\") pod \"93bd8f46-bd09-47b6-b5e2-2617bba86164\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " Jul 22 02:40:14.930866 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:14.930754 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnzhv\" (UniqueName: \"kubernetes.io/projected/93bd8f46-bd09-47b6-b5e2-2617bba86164-kube-api-access-dnzhv\") pod \"93bd8f46-bd09-47b6-b5e2-2617bba86164\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " Jul 22 02:40:14.930866 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:14.930788 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-tmp-dir\") pod \"93bd8f46-bd09-47b6-b5e2-2617bba86164\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " Jul 22 02:40:14.930866 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:14.930809 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-model-cache\") pod \"93bd8f46-bd09-47b6-b5e2-2617bba86164\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " Jul 22 02:40:14.931099 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:14.930961 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93bd8f46-bd09-47b6-b5e2-2617bba86164-tls-certs\") pod \"93bd8f46-bd09-47b6-b5e2-2617bba86164\" (UID: \"93bd8f46-bd09-47b6-b5e2-2617bba86164\") " Jul 22 02:40:14.931099 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:14.930985 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-home" (OuterVolumeSpecName: "home") pod "93bd8f46-bd09-47b6-b5e2-2617bba86164" (UID: "93bd8f46-bd09-47b6-b5e2-2617bba86164"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:40:14.931198 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:14.931172 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-model-cache" (OuterVolumeSpecName: "model-cache") pod "93bd8f46-bd09-47b6-b5e2-2617bba86164" (UID: "93bd8f46-bd09-47b6-b5e2-2617bba86164"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:40:14.931198 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:14.931179 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "93bd8f46-bd09-47b6-b5e2-2617bba86164" (UID: "93bd8f46-bd09-47b6-b5e2-2617bba86164"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:40:14.931305 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:14.931295 2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-tmp-dir\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:40:14.931343 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:14.931307 2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-model-cache\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:40:14.931343 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:14.931317 2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-home\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:40:14.933115 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:14.933095 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-dshm" (OuterVolumeSpecName: "dshm") pod "93bd8f46-bd09-47b6-b5e2-2617bba86164" (UID: "93bd8f46-bd09-47b6-b5e2-2617bba86164"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:40:14.933190 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:14.933168 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93bd8f46-bd09-47b6-b5e2-2617bba86164-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "93bd8f46-bd09-47b6-b5e2-2617bba86164" (UID: "93bd8f46-bd09-47b6-b5e2-2617bba86164"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:40:14.933229 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:14.933172 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93bd8f46-bd09-47b6-b5e2-2617bba86164-kube-api-access-dnzhv" (OuterVolumeSpecName: "kube-api-access-dnzhv") pod "93bd8f46-bd09-47b6-b5e2-2617bba86164" (UID: "93bd8f46-bd09-47b6-b5e2-2617bba86164"). InnerVolumeSpecName "kube-api-access-dnzhv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:40:15.032150 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:15.032111 2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93bd8f46-bd09-47b6-b5e2-2617bba86164-tls-certs\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:40:15.032150 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:15.032145 2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93bd8f46-bd09-47b6-b5e2-2617bba86164-dshm\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:40:15.032150 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:15.032157 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnzhv\" (UniqueName: \"kubernetes.io/projected/93bd8f46-bd09-47b6-b5e2-2617bba86164-kube-api-access-dnzhv\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:40:15.257171 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:15.257135 2556 generic.go:356] "Generic (PLEG): container finished" podID="93bd8f46-bd09-47b6-b5e2-2617bba86164" containerID="f11d50555c0fd9a02169c11a97b4c6ca1bff3cf28e8c2cc9739746c360981c7c" exitCode=0 Jul 22 02:40:15.257370 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:15.257190 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" Jul 22 02:40:15.257370 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:15.257221 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" event={"ID":"93bd8f46-bd09-47b6-b5e2-2617bba86164","Type":"ContainerDied","Data":"f11d50555c0fd9a02169c11a97b4c6ca1bff3cf28e8c2cc9739746c360981c7c"} Jul 22 02:40:15.257370 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:15.257271 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz" event={"ID":"93bd8f46-bd09-47b6-b5e2-2617bba86164","Type":"ContainerDied","Data":"3ccfcecf9e3f2610af087a84a870cc2e96e003b9071a18fe134dc97b63e11e31"} Jul 22 02:40:15.257370 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:15.257293 2556 scope.go:117] "RemoveContainer" containerID="f11d50555c0fd9a02169c11a97b4c6ca1bff3cf28e8c2cc9739746c360981c7c" Jul 22 02:40:15.267196 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:15.267179 2556 scope.go:117] "RemoveContainer" containerID="f11d50555c0fd9a02169c11a97b4c6ca1bff3cf28e8c2cc9739746c360981c7c" Jul 22 02:40:15.267487 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:40:15.267466 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f11d50555c0fd9a02169c11a97b4c6ca1bff3cf28e8c2cc9739746c360981c7c\": container with ID starting with f11d50555c0fd9a02169c11a97b4c6ca1bff3cf28e8c2cc9739746c360981c7c not found: ID does not exist" containerID="f11d50555c0fd9a02169c11a97b4c6ca1bff3cf28e8c2cc9739746c360981c7c" Jul 22 02:40:15.267548 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:15.267501 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f11d50555c0fd9a02169c11a97b4c6ca1bff3cf28e8c2cc9739746c360981c7c"} err="failed to get container status \"f11d50555c0fd9a02169c11a97b4c6ca1bff3cf28e8c2cc9739746c360981c7c\": rpc error: code = NotFound desc = could not find container \"f11d50555c0fd9a02169c11a97b4c6ca1bff3cf28e8c2cc9739746c360981c7c\": container with ID starting with f11d50555c0fd9a02169c11a97b4c6ca1bff3cf28e8c2cc9739746c360981c7c not found: ID does not exist" Jul 22 02:40:15.281074 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:15.281046 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz"] Jul 22 02:40:15.286249 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:15.286223 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-c5afd956-kserve-665f49b9f-zlqtz"] Jul 22 02:40:16.254823 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:40:16.254792 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93bd8f46-bd09-47b6-b5e2-2617bba86164" path="/var/lib/kubelet/pods/93bd8f46-bd09-47b6-b5e2-2617bba86164/volumes" Jul 22 02:43:41.631846 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.631764 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q"] Jul 22 02:43:41.632301 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.632101 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93bd8f46-bd09-47b6-b5e2-2617bba86164" containerName="main" Jul 22 02:43:41.632301 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.632112 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="93bd8f46-bd09-47b6-b5e2-2617bba86164" containerName="main" Jul 22 02:43:41.632301 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.632177 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="93bd8f46-bd09-47b6-b5e2-2617bba86164" containerName="main" Jul 22 02:43:41.635079 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.635062 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.638313 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.638290 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e46537b5-openshift-default-dockercfg-stzcr\"" Jul 22 02:43:41.671608 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.671576 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-data\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.671813 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.671662 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-token\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.671813 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.671795 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-credential-socket\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.671951 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.671826 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-podinfo\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.671951 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.671862 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-envoy\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.671951 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.671900 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e3f5f95-7f12-45da-a700-2414f46d54e9-istiod-ca-cert\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.672089 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.671949 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-workload-socket\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.672089 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.671996 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnvzn\" (UniqueName: \"kubernetes.io/projected/0e3f5f95-7f12-45da-a700-2414f46d54e9-kube-api-access-tnvzn\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.672089 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.672021 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-workload-certs\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.675125 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.675103 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q"] Jul 22 02:43:41.772700 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.772630 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-data\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.772888 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.772722 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-token\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.772888 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.772777 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-credential-socket\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.772888 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.772800 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-podinfo\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.772888 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.772834 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-envoy\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.772888 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.772868 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e3f5f95-7f12-45da-a700-2414f46d54e9-istiod-ca-cert\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.773211 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.772914 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-workload-socket\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.773211 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.772939 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnvzn\" (UniqueName: \"kubernetes.io/projected/0e3f5f95-7f12-45da-a700-2414f46d54e9-kube-api-access-tnvzn\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.773211 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.772970 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-workload-certs\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.773211 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.773117 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-data\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.773419 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.773351 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-credential-socket\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.773419 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.773359 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-workload-certs\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.773419 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.773377 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-workload-socket\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.773736 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.773716 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e3f5f95-7f12-45da-a700-2414f46d54e9-istiod-ca-cert\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.775212 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.775191 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-envoy\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.775359 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.775340 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-podinfo\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.781635 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.781615 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-token\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.781961 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.781940 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnvzn\" (UniqueName: \"kubernetes.io/projected/0e3f5f95-7f12-45da-a700-2414f46d54e9-kube-api-access-tnvzn\") pod \"e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:41.945080 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:41.945044 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:42.090564 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:42.090537 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q"] Jul 22 02:43:42.092804 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:43:42.092770 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e3f5f95_7f12_45da_a700_2414f46d54e9.slice/crio-45d5c5e3e2f0b246a48251fc28282fa7552a828acffe055897a3b0d958b4e905 WatchSource:0}: Error finding container 45d5c5e3e2f0b246a48251fc28282fa7552a828acffe055897a3b0d958b4e905: Status 404 returned error can't find the container with id 45d5c5e3e2f0b246a48251fc28282fa7552a828acffe055897a3b0d958b4e905 Jul 22 02:43:42.094960 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:42.094929 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:43:42.095031 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:42.094995 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:43:42.095068 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:42.095030 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:43:42.305087 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:42.304986 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" event={"ID":"0e3f5f95-7f12-45da-a700-2414f46d54e9","Type":"ContainerStarted","Data":"5598a952b8c2913d1aae397982583bf5042705daa971659a7b802dccb3feef77"} Jul 22 02:43:42.305087 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:42.305044 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" event={"ID":"0e3f5f95-7f12-45da-a700-2414f46d54e9","Type":"ContainerStarted","Data":"45d5c5e3e2f0b246a48251fc28282fa7552a828acffe055897a3b0d958b4e905"} Jul 22 02:43:42.330589 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:42.330536 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" podStartSLOduration=1.33051879 podStartE2EDuration="1.33051879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:43:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:43:42.328083673 +0000 UTC m=+1623.436503030" watchObservedRunningTime="2026-07-22 02:43:42.33051879 +0000 UTC m=+1623.438938185" Jul 22 02:43:42.945440 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:42.945403 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:43.950347 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:43.950320 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:44.315423 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:44.315347 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:43:44.316283 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:43:44.316261 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:44:00.190987 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:00.190092 2556 patch_prober.go:28] interesting pod/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": read tcp 10.133.0.2:54356->10.133.0.37:15021: read: connection reset by peer" start-of-body= Jul 22 02:44:00.190987 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:00.190165 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" podUID="0e3f5f95-7f12-45da-a700-2414f46d54e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": read tcp 10.133.0.2:54356->10.133.0.37:15021: read: connection reset by peer" Jul 22 02:44:00.403971 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:00.403879 2556 generic.go:356] "Generic (PLEG): container finished" podID="0e3f5f95-7f12-45da-a700-2414f46d54e9" containerID="5598a952b8c2913d1aae397982583bf5042705daa971659a7b802dccb3feef77" exitCode=0 Jul 22 02:44:00.403971 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:00.403958 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" event={"ID":"0e3f5f95-7f12-45da-a700-2414f46d54e9","Type":"ContainerDied","Data":"5598a952b8c2913d1aae397982583bf5042705daa971659a7b802dccb3feef77"} Jul 22 02:44:00.404366 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:00.404353 2556 scope.go:117] "RemoveContainer" containerID="5598a952b8c2913d1aae397982583bf5042705daa971659a7b802dccb3feef77" Jul 22 02:44:00.405364 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:00.405337 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:44:00.405453 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:00.405400 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:44:00.405453 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:00.405431 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:44:01.411237 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:01.411197 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" event={"ID":"0e3f5f95-7f12-45da-a700-2414f46d54e9","Type":"ContainerStarted","Data":"c6d46ca3c2659788edd8fe413da4627c27492110e0060bb40b29c72a234d9937"} Jul 22 02:44:01.946253 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:01.946167 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:44:01.946565 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:01.946541 2556 patch_prober.go:28] interesting pod/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 22 02:44:01.946764 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:01.946739 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" podUID="0e3f5f95-7f12-45da-a700-2414f46d54e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 22 02:44:02.945718 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:02.945674 2556 patch_prober.go:28] interesting pod/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 22 02:44:02.946245 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:02.945764 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" podUID="0e3f5f95-7f12-45da-a700-2414f46d54e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 22 02:44:03.946281 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:03.946236 2556 patch_prober.go:28] interesting pod/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 22 02:44:03.946902 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:03.946866 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" podUID="0e3f5f95-7f12-45da-a700-2414f46d54e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 22 02:44:04.946476 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:04.946436 2556 patch_prober.go:28] interesting pod/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 22 02:44:04.947109 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:04.947071 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" podUID="0e3f5f95-7f12-45da-a700-2414f46d54e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 22 02:44:05.949010 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:05.948978 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:44:05.949384 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:05.949307 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:44:05.949942 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:05.949926 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:44:09.276515 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:09.276477 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e46537b5-26fq2"] Jul 22 02:44:09.279935 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:09.279919 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e46537b5-26fq2" Jul 22 02:44:09.282907 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:09.282885 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rt9zm\"" Jul 22 02:44:09.283017 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:09.282887 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 02:44:09.289720 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:09.289697 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e46537b5-26fq2"] Jul 22 02:44:09.439814 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:09.439777 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9741cde-6b68-44ce-bff2-661436787e57-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e46537b5-26fq2\" (UID: \"e9741cde-6b68-44ce-bff2-661436787e57\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e46537b5-26fq2" Jul 22 02:44:09.541010 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:09.540921 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9741cde-6b68-44ce-bff2-661436787e57-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e46537b5-26fq2\" (UID: \"e9741cde-6b68-44ce-bff2-661436787e57\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e46537b5-26fq2" Jul 22 02:44:09.541568 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:09.541541 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9741cde-6b68-44ce-bff2-661436787e57-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e46537b5-26fq2\" (UID: \"e9741cde-6b68-44ce-bff2-661436787e57\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e46537b5-26fq2" Jul 22 02:44:09.591904 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:09.591872 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e46537b5-26fq2" Jul 22 02:44:09.725243 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:09.725198 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e46537b5-26fq2"] Jul 22 02:44:09.729497 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:44:09.729469 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9741cde_6b68_44ce_bff2_661436787e57.slice/crio-844fd2adb5a28952151a516bd318611480bf656fd41f3964d9fc932db0f72992 WatchSource:0}: Error finding container 844fd2adb5a28952151a516bd318611480bf656fd41f3964d9fc932db0f72992: Status 404 returned error can't find the container with id 844fd2adb5a28952151a516bd318611480bf656fd41f3964d9fc932db0f72992 Jul 22 02:44:10.459627 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:10.459600 2556 generic.go:356] "Generic (PLEG): container finished" podID="e9741cde-6b68-44ce-bff2-661436787e57" containerID="e436c18150268b45fdd5b9fab19fc0b9c375f48ea814097a3154a3277fbf0cfe" exitCode=0 Jul 22 02:44:10.459953 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:10.459685 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e46537b5-26fq2" event={"ID":"e9741cde-6b68-44ce-bff2-661436787e57","Type":"ContainerDied","Data":"e436c18150268b45fdd5b9fab19fc0b9c375f48ea814097a3154a3277fbf0cfe"} Jul 22 02:44:10.459953 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:10.459738 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e46537b5-26fq2" event={"ID":"e9741cde-6b68-44ce-bff2-661436787e57","Type":"ContainerStarted","Data":"844fd2adb5a28952151a516bd318611480bf656fd41f3964d9fc932db0f72992"} Jul 22 02:44:11.597259 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:11.597235 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e46537b5-26fq2" Jul 22 02:44:11.760760 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:11.760629 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9741cde-6b68-44ce-bff2-661436787e57-maas-api-service-ca\") pod \"e9741cde-6b68-44ce-bff2-661436787e57\" (UID: \"e9741cde-6b68-44ce-bff2-661436787e57\") " Jul 22 02:44:11.761015 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:11.760990 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9741cde-6b68-44ce-bff2-661436787e57-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e9741cde-6b68-44ce-bff2-661436787e57" (UID: "e9741cde-6b68-44ce-bff2-661436787e57"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:44:11.862266 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:11.862226 2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9741cde-6b68-44ce-bff2-661436787e57-maas-api-service-ca\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:44:12.471893 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:12.471866 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e46537b5-26fq2" Jul 22 02:44:12.472055 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:12.471865 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e46537b5-26fq2" event={"ID":"e9741cde-6b68-44ce-bff2-661436787e57","Type":"ContainerDied","Data":"844fd2adb5a28952151a516bd318611480bf656fd41f3964d9fc932db0f72992"} Jul 22 02:44:12.472055 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:12.471991 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="844fd2adb5a28952151a516bd318611480bf656fd41f3964d9fc932db0f72992" Jul 22 02:44:24.355948 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:24.355916 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e46537b5-26fq2"] Jul 22 02:44:24.358078 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:24.358057 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e46537b5-26fq2"] Jul 22 02:44:24.490835 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:24.490804 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q"] Jul 22 02:44:24.491055 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:24.491013 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" podUID="0e3f5f95-7f12-45da-a700-2414f46d54e9" containerName="istio-proxy" containerID="cri-o://c6d46ca3c2659788edd8fe413da4627c27492110e0060bb40b29c72a234d9937" gracePeriod=30 Jul 22 02:44:25.507779 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.507731 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk"] Jul 22 02:44:25.508274 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.508253 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9741cde-6b68-44ce-bff2-661436787e57" containerName="revoke-keys" Jul 22 02:44:25.508348 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.508283 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9741cde-6b68-44ce-bff2-661436787e57" containerName="revoke-keys" Jul 22 02:44:25.508434 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.508421 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9741cde-6b68-44ce-bff2-661436787e57" containerName="revoke-keys" Jul 22 02:44:25.511697 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.511677 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.514880 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.514859 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-12ff7d8c-gw-openshift-default-dockercfg-f8d96\"" Jul 22 02:44:25.523383 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.523358 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk"] Jul 22 02:44:25.579546 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.579509 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-podinfo\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.579546 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.579547 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-workload-certs\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.579759 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.579563 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-data\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.579759 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.579606 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-token\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.579759 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.579679 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-credential-socket\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.579861 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.579760 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istiod-ca-cert\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.579861 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.579797 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4626p\" (UniqueName: \"kubernetes.io/projected/1800cad2-f3f9-41db-98f1-ac1d85e125e9-kube-api-access-4626p\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.579861 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.579851 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-envoy\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.579980 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.579895 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-workload-socket\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.681022 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.680982 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-envoy\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.681022 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.681026 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-workload-socket\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.681234 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.681157 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-podinfo\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.681234 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.681198 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-workload-certs\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.681234 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.681223 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-data\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.681390 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.681249 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-token\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.681390 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.681289 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-credential-socket\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.681496 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.681395 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istiod-ca-cert\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.681496 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.681450 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4626p\" (UniqueName: \"kubernetes.io/projected/1800cad2-f3f9-41db-98f1-ac1d85e125e9-kube-api-access-4626p\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.681661 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.681617 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-workload-certs\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.681752 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.681718 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-credential-socket\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.681810 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.681776 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-data\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.681872 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.681828 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-workload-socket\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.682210 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.682187 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istiod-ca-cert\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.683406 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.683387 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-envoy\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.683503 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.683485 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-podinfo\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.689890 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.689862 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-token\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.690030 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.690007 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4626p\" (UniqueName: \"kubernetes.io/projected/1800cad2-f3f9-41db-98f1-ac1d85e125e9-kube-api-access-4626p\") pod \"e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.822201 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.822122 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:25.962439 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.962348 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk"] Jul 22 02:44:25.965331 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:44:25.965289 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1800cad2_f3f9_41db_98f1_ac1d85e125e9.slice/crio-3f209eedd30454c5817f19e95c27379624702a2a0e7f2c3e5dbb1c01584d9c49 WatchSource:0}: Error finding container 3f209eedd30454c5817f19e95c27379624702a2a0e7f2c3e5dbb1c01584d9c49: Status 404 returned error can't find the container with id 3f209eedd30454c5817f19e95c27379624702a2a0e7f2c3e5dbb1c01584d9c49 Jul 22 02:44:25.967495 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.967460 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:44:25.967611 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.967527 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:44:25.967611 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:25.967554 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:44:26.256174 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:26.256133 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9741cde-6b68-44ce-bff2-661436787e57" path="/var/lib/kubelet/pods/e9741cde-6b68-44ce-bff2-661436787e57/volumes" Jul 22 02:44:26.548741 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:26.548660 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" event={"ID":"1800cad2-f3f9-41db-98f1-ac1d85e125e9","Type":"ContainerStarted","Data":"807d3426f2f8b585ed5f988624de87218dc9a93f8107bbe1e4416147e9ee7f5b"} Jul 22 02:44:26.548741 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:26.548709 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" event={"ID":"1800cad2-f3f9-41db-98f1-ac1d85e125e9","Type":"ContainerStarted","Data":"3f209eedd30454c5817f19e95c27379624702a2a0e7f2c3e5dbb1c01584d9c49"} Jul 22 02:44:26.569233 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:26.569185 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" podStartSLOduration=1.5691684860000001 podStartE2EDuration="1.569168486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:44:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:44:26.568088214 +0000 UTC m=+1667.676507552" watchObservedRunningTime="2026-07-22 02:44:26.569168486 +0000 UTC m=+1667.677587868" Jul 22 02:44:26.822261 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:26.822174 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:27.827946 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:27.827914 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:28.559994 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:28.559958 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:28.561294 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:28.561266 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:29.748597 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.748571 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:44:29.819470 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.819395 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-podinfo\") pod \"0e3f5f95-7f12-45da-a700-2414f46d54e9\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " Jul 22 02:44:29.819470 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.819441 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnvzn\" (UniqueName: \"kubernetes.io/projected/0e3f5f95-7f12-45da-a700-2414f46d54e9-kube-api-access-tnvzn\") pod \"0e3f5f95-7f12-45da-a700-2414f46d54e9\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " Jul 22 02:44:29.819470 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.819472 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-token\") pod \"0e3f5f95-7f12-45da-a700-2414f46d54e9\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " Jul 22 02:44:29.819752 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.819490 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-credential-socket\") pod \"0e3f5f95-7f12-45da-a700-2414f46d54e9\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " Jul 22 02:44:29.819752 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.819631 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-data\") pod \"0e3f5f95-7f12-45da-a700-2414f46d54e9\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " Jul 22 02:44:29.819752 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.819688 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e3f5f95-7f12-45da-a700-2414f46d54e9-istiod-ca-cert\") pod \"0e3f5f95-7f12-45da-a700-2414f46d54e9\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " Jul 22 02:44:29.819752 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.819723 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-workload-certs\") pod \"0e3f5f95-7f12-45da-a700-2414f46d54e9\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " Jul 22 02:44:29.819940 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.819751 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-workload-socket\") pod \"0e3f5f95-7f12-45da-a700-2414f46d54e9\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " Jul 22 02:44:29.819940 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.819793 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-envoy\") pod \"0e3f5f95-7f12-45da-a700-2414f46d54e9\" (UID: \"0e3f5f95-7f12-45da-a700-2414f46d54e9\") " Jul 22 02:44:29.819940 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.819798 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0e3f5f95-7f12-45da-a700-2414f46d54e9" (UID: "0e3f5f95-7f12-45da-a700-2414f46d54e9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:44:29.820174 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.820005 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0e3f5f95-7f12-45da-a700-2414f46d54e9" (UID: "0e3f5f95-7f12-45da-a700-2414f46d54e9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:44:29.820274 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.820173 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0e3f5f95-7f12-45da-a700-2414f46d54e9" (UID: "0e3f5f95-7f12-45da-a700-2414f46d54e9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:44:29.820384 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.820345 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e3f5f95-7f12-45da-a700-2414f46d54e9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0e3f5f95-7f12-45da-a700-2414f46d54e9" (UID: "0e3f5f95-7f12-45da-a700-2414f46d54e9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:44:29.820549 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.820508 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-data" (OuterVolumeSpecName: "istio-data") pod "0e3f5f95-7f12-45da-a700-2414f46d54e9" (UID: "0e3f5f95-7f12-45da-a700-2414f46d54e9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:44:29.820738 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.820708 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-credential-socket\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:44:29.820806 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.820737 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-data\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:44:29.820806 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.820753 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e3f5f95-7f12-45da-a700-2414f46d54e9-istiod-ca-cert\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:44:29.820806 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.820768 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-workload-certs\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:44:29.820806 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.820781 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-workload-socket\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:44:29.822357 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.822322 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0e3f5f95-7f12-45da-a700-2414f46d54e9" (UID: "0e3f5f95-7f12-45da-a700-2414f46d54e9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:44:29.822357 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.822340 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e3f5f95-7f12-45da-a700-2414f46d54e9-kube-api-access-tnvzn" (OuterVolumeSpecName: "kube-api-access-tnvzn") pod "0e3f5f95-7f12-45da-a700-2414f46d54e9" (UID: "0e3f5f95-7f12-45da-a700-2414f46d54e9"). InnerVolumeSpecName "kube-api-access-tnvzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:44:29.822507 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.822362 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-token" (OuterVolumeSpecName: "istio-token") pod "0e3f5f95-7f12-45da-a700-2414f46d54e9" (UID: "0e3f5f95-7f12-45da-a700-2414f46d54e9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:44:29.822507 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.822427 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0e3f5f95-7f12-45da-a700-2414f46d54e9" (UID: "0e3f5f95-7f12-45da-a700-2414f46d54e9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 02:44:29.921836 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.921804 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-envoy\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:44:29.921836 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.921830 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-podinfo\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:44:29.921836 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.921840 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnvzn\" (UniqueName: \"kubernetes.io/projected/0e3f5f95-7f12-45da-a700-2414f46d54e9-kube-api-access-tnvzn\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:44:29.922063 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:29.921851 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e3f5f95-7f12-45da-a700-2414f46d54e9-istio-token\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:44:30.572696 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:30.572588 2556 generic.go:356] "Generic (PLEG): container finished" podID="0e3f5f95-7f12-45da-a700-2414f46d54e9" containerID="c6d46ca3c2659788edd8fe413da4627c27492110e0060bb40b29c72a234d9937" exitCode=0 Jul 22 02:44:30.572696 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:30.572663 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" Jul 22 02:44:30.572696 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:30.572680 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" event={"ID":"0e3f5f95-7f12-45da-a700-2414f46d54e9","Type":"ContainerDied","Data":"c6d46ca3c2659788edd8fe413da4627c27492110e0060bb40b29c72a234d9937"} Jul 22 02:44:30.572918 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:30.572745 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q" event={"ID":"0e3f5f95-7f12-45da-a700-2414f46d54e9","Type":"ContainerDied","Data":"45d5c5e3e2f0b246a48251fc28282fa7552a828acffe055897a3b0d958b4e905"} Jul 22 02:44:30.572918 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:30.572771 2556 scope.go:117] "RemoveContainer" containerID="c6d46ca3c2659788edd8fe413da4627c27492110e0060bb40b29c72a234d9937" Jul 22 02:44:30.582265 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:30.582235 2556 scope.go:117] "RemoveContainer" containerID="5598a952b8c2913d1aae397982583bf5042705daa971659a7b802dccb3feef77" Jul 22 02:44:30.590349 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:30.590327 2556 scope.go:117] "RemoveContainer" containerID="c6d46ca3c2659788edd8fe413da4627c27492110e0060bb40b29c72a234d9937" Jul 22 02:44:30.590771 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:44:30.590656 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6d46ca3c2659788edd8fe413da4627c27492110e0060bb40b29c72a234d9937\": container with ID starting with c6d46ca3c2659788edd8fe413da4627c27492110e0060bb40b29c72a234d9937 not found: ID does not exist" containerID="c6d46ca3c2659788edd8fe413da4627c27492110e0060bb40b29c72a234d9937" Jul 22 02:44:30.590771 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:30.590699 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6d46ca3c2659788edd8fe413da4627c27492110e0060bb40b29c72a234d9937"} err="failed to get container status \"c6d46ca3c2659788edd8fe413da4627c27492110e0060bb40b29c72a234d9937\": rpc error: code = NotFound desc = could not find container \"c6d46ca3c2659788edd8fe413da4627c27492110e0060bb40b29c72a234d9937\": container with ID starting with c6d46ca3c2659788edd8fe413da4627c27492110e0060bb40b29c72a234d9937 not found: ID does not exist" Jul 22 02:44:30.590771 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:30.590727 2556 scope.go:117] "RemoveContainer" containerID="5598a952b8c2913d1aae397982583bf5042705daa971659a7b802dccb3feef77" Jul 22 02:44:30.591135 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:44:30.591022 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5598a952b8c2913d1aae397982583bf5042705daa971659a7b802dccb3feef77\": container with ID starting with 5598a952b8c2913d1aae397982583bf5042705daa971659a7b802dccb3feef77 not found: ID does not exist" containerID="5598a952b8c2913d1aae397982583bf5042705daa971659a7b802dccb3feef77" Jul 22 02:44:30.591135 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:30.591051 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5598a952b8c2913d1aae397982583bf5042705daa971659a7b802dccb3feef77"} err="failed to get container status \"5598a952b8c2913d1aae397982583bf5042705daa971659a7b802dccb3feef77\": rpc error: code = NotFound desc = could not find container \"5598a952b8c2913d1aae397982583bf5042705daa971659a7b802dccb3feef77\": container with ID starting with 5598a952b8c2913d1aae397982583bf5042705daa971659a7b802dccb3feef77 not found: ID does not exist" Jul 22 02:44:30.593619 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:30.593596 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q"] Jul 22 02:44:30.598620 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:30.598599 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e46537b5-openshift-default-694997c6cc-xg25q"] Jul 22 02:44:32.254946 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:32.254916 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e3f5f95-7f12-45da-a700-2414f46d54e9" path="/var/lib/kubelet/pods/0e3f5f95-7f12-45da-a700-2414f46d54e9/volumes" Jul 22 02:44:42.635736 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:42.635700 2556 generic.go:356] "Generic (PLEG): container finished" podID="1800cad2-f3f9-41db-98f1-ac1d85e125e9" containerID="807d3426f2f8b585ed5f988624de87218dc9a93f8107bbe1e4416147e9ee7f5b" exitCode=0 Jul 22 02:44:42.636138 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:42.635774 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" event={"ID":"1800cad2-f3f9-41db-98f1-ac1d85e125e9","Type":"ContainerDied","Data":"807d3426f2f8b585ed5f988624de87218dc9a93f8107bbe1e4416147e9ee7f5b"} Jul 22 02:44:42.636178 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:42.636161 2556 scope.go:117] "RemoveContainer" containerID="807d3426f2f8b585ed5f988624de87218dc9a93f8107bbe1e4416147e9ee7f5b" Jul 22 02:44:42.637266 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:42.637239 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:44:42.637340 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:42.637323 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:44:42.637396 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:42.637375 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:44:43.560422 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:43.560383 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:43.646630 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:43.646043 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" event={"ID":"1800cad2-f3f9-41db-98f1-ac1d85e125e9","Type":"ContainerStarted","Data":"e50c509f18849a35822e461aefccd33abc67e2288833fe22bf73182928fcd202"} Jul 22 02:44:43.822630 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:43.822529 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:43.823846 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:43.823821 2556 patch_prober.go:28] interesting pod/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 22 02:44:43.823957 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:43.823882 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" podUID="1800cad2-f3f9-41db-98f1-ac1d85e125e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 22 02:44:44.822749 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:44.822708 2556 patch_prober.go:28] interesting pod/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 22 02:44:44.823214 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:44.822769 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" podUID="1800cad2-f3f9-41db-98f1-ac1d85e125e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 22 02:44:45.823572 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:45.823534 2556 patch_prober.go:28] interesting pod/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 22 02:44:45.823975 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:45.823595 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" podUID="1800cad2-f3f9-41db-98f1-ac1d85e125e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 22 02:44:46.823405 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:46.823363 2556 patch_prober.go:28] interesting pod/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 22 02:44:46.823611 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:46.823426 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" podUID="1800cad2-f3f9-41db-98f1-ac1d85e125e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 22 02:44:47.826797 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:47.826761 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:47.827259 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:47.827049 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:47.827681 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:47.827661 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:44:53.092113 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:53.092075 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-12ff7d8c-9qxvc"] Jul 22 02:44:53.092484 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:53.092448 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e3f5f95-7f12-45da-a700-2414f46d54e9" containerName="istio-proxy" Jul 22 02:44:53.092484 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:53.092460 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e3f5f95-7f12-45da-a700-2414f46d54e9" containerName="istio-proxy" Jul 22 02:44:53.092558 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:53.092529 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e3f5f95-7f12-45da-a700-2414f46d54e9" containerName="istio-proxy" Jul 22 02:44:53.095956 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:53.095940 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-12ff7d8c-9qxvc" Jul 22 02:44:53.099523 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:53.099499 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rt9zm\"" Jul 22 02:44:53.099859 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:53.099836 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 02:44:53.110153 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:53.110127 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-12ff7d8c-9qxvc"] Jul 22 02:44:53.236703 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:53.236661 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c34661f9-adb3-47c7-8af5-d682324a6790-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-12ff7d8c-9qxvc\" (UID: \"c34661f9-adb3-47c7-8af5-d682324a6790\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-12ff7d8c-9qxvc" Jul 22 02:44:53.337943 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:53.337905 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c34661f9-adb3-47c7-8af5-d682324a6790-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-12ff7d8c-9qxvc\" (UID: \"c34661f9-adb3-47c7-8af5-d682324a6790\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-12ff7d8c-9qxvc" Jul 22 02:44:53.338532 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:53.338514 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c34661f9-adb3-47c7-8af5-d682324a6790-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-12ff7d8c-9qxvc\" (UID: \"c34661f9-adb3-47c7-8af5-d682324a6790\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-12ff7d8c-9qxvc" Jul 22 02:44:53.406011 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:53.405921 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-12ff7d8c-9qxvc" Jul 22 02:44:53.545507 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:53.545472 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-12ff7d8c-9qxvc"] Jul 22 02:44:53.546794 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:44:53.546766 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc34661f9_adb3_47c7_8af5_d682324a6790.slice/crio-bae7565c9eba5f02b6570e9cb592169b74f57d87791427fad480fd9ff89def73 WatchSource:0}: Error finding container bae7565c9eba5f02b6570e9cb592169b74f57d87791427fad480fd9ff89def73: Status 404 returned error can't find the container with id bae7565c9eba5f02b6570e9cb592169b74f57d87791427fad480fd9ff89def73 Jul 22 02:44:53.712371 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:53.712334 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-12ff7d8c-9qxvc" event={"ID":"c34661f9-adb3-47c7-8af5-d682324a6790","Type":"ContainerStarted","Data":"bae7565c9eba5f02b6570e9cb592169b74f57d87791427fad480fd9ff89def73"} Jul 22 02:44:54.718733 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:54.718698 2556 generic.go:356] "Generic (PLEG): container finished" podID="c34661f9-adb3-47c7-8af5-d682324a6790" containerID="c9108dd218b79b719222c4ad89f664ba7826c3b5d6b5c3c09e5a6f0936af98bf" exitCode=0 Jul 22 02:44:54.719106 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:54.718771 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-12ff7d8c-9qxvc" event={"ID":"c34661f9-adb3-47c7-8af5-d682324a6790","Type":"ContainerDied","Data":"c9108dd218b79b719222c4ad89f664ba7826c3b5d6b5c3c09e5a6f0936af98bf"} Jul 22 02:44:55.855787 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:55.855762 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-12ff7d8c-9qxvc" Jul 22 02:44:55.964142 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:55.964109 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c34661f9-adb3-47c7-8af5-d682324a6790-maas-api-service-ca\") pod \"c34661f9-adb3-47c7-8af5-d682324a6790\" (UID: \"c34661f9-adb3-47c7-8af5-d682324a6790\") " Jul 22 02:44:55.964513 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:55.964491 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c34661f9-adb3-47c7-8af5-d682324a6790-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c34661f9-adb3-47c7-8af5-d682324a6790" (UID: "c34661f9-adb3-47c7-8af5-d682324a6790"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:44:56.065716 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:56.065605 2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c34661f9-adb3-47c7-8af5-d682324a6790-maas-api-service-ca\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:44:56.730282 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:56.730256 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-12ff7d8c-9qxvc" Jul 22 02:44:56.730282 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:56.730259 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-12ff7d8c-9qxvc" event={"ID":"c34661f9-adb3-47c7-8af5-d682324a6790","Type":"ContainerDied","Data":"bae7565c9eba5f02b6570e9cb592169b74f57d87791427fad480fd9ff89def73"} Jul 22 02:44:56.730501 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:44:56.730310 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bae7565c9eba5f02b6570e9cb592169b74f57d87791427fad480fd9ff89def73" Jul 22 02:45:00.153314 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.153274 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-12ff7d8c-29744805-qsrj7"] Jul 22 02:45:00.153809 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.153706 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c34661f9-adb3-47c7-8af5-d682324a6790" containerName="revoke-keys" Jul 22 02:45:00.153809 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.153719 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c34661f9-adb3-47c7-8af5-d682324a6790" containerName="revoke-keys" Jul 22 02:45:00.153809 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.153737 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e3f5f95-7f12-45da-a700-2414f46d54e9" containerName="istio-proxy" Jul 22 02:45:00.153809 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.153743 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e3f5f95-7f12-45da-a700-2414f46d54e9" containerName="istio-proxy" Jul 22 02:45:00.153809 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.153799 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c34661f9-adb3-47c7-8af5-d682324a6790" containerName="revoke-keys" Jul 22 02:45:00.153809 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.153810 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e3f5f95-7f12-45da-a700-2414f46d54e9" containerName="istio-proxy" Jul 22 02:45:00.157164 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.157139 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-12ff7d8c-29744805-qsrj7" Jul 22 02:45:00.158604 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.158577 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744805-2csrn"] Jul 22 02:45:00.160994 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.160973 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rt9zm\"" Jul 22 02:45:00.162202 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.162182 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744805-2csrn" Jul 22 02:45:00.168113 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.168096 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-12ff7d8c-29744805-qsrj7" Jul 22 02:45:00.171821 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.171801 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-12ff7d8c-29744805-qsrj7"] Jul 22 02:45:00.177934 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.177909 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744805-2csrn" Jul 22 02:45:00.180237 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.180215 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744805-2csrn"] Jul 22 02:45:00.332967 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.332937 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-12ff7d8c-29744805-qsrj7"] Jul 22 02:45:00.334895 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:45:00.334634 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod579b91ad_d72d_4218_a7f1_bc580de1b07d.slice/crio-9e256147fa8a929c16dc2c6c11f27c93467c63c7b6c6c620325ceddcf372c732 WatchSource:0}: Error finding container 9e256147fa8a929c16dc2c6c11f27c93467c63c7b6c6c620325ceddcf372c732: Status 404 returned error can't find the container with id 9e256147fa8a929c16dc2c6c11f27c93467c63c7b6c6c620325ceddcf372c732 Jul 22 02:45:00.567289 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.567266 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744805-2csrn"] Jul 22 02:45:00.568194 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:45:00.568174 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37bfabd4_e8e3_4cc9_a14b_5d2f3b4bb6d1.slice/crio-bd00da8b2e7511e70bd6fed24e031a00835101e6d8f815192d1a49502a785084 WatchSource:0}: Error finding container bd00da8b2e7511e70bd6fed24e031a00835101e6d8f815192d1a49502a785084: Status 404 returned error can't find the container with id bd00da8b2e7511e70bd6fed24e031a00835101e6d8f815192d1a49502a785084 Jul 22 02:45:00.752508 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.752472 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744805-2csrn" event={"ID":"37bfabd4-e8e3-4cc9-a14b-5d2f3b4bb6d1","Type":"ContainerStarted","Data":"bd00da8b2e7511e70bd6fed24e031a00835101e6d8f815192d1a49502a785084"} Jul 22 02:45:00.754094 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.754046 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-12ff7d8c-29744805-qsrj7" event={"ID":"579b91ad-d72d-4218-a7f1-bc580de1b07d","Type":"ContainerStarted","Data":"6efe97178e9566876581ee3649c2ebbb9bc99625e47d327d218e91cc28bce6bd"} Jul 22 02:45:00.754179 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.754099 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-12ff7d8c-29744805-qsrj7" event={"ID":"579b91ad-d72d-4218-a7f1-bc580de1b07d","Type":"ContainerStarted","Data":"9e256147fa8a929c16dc2c6c11f27c93467c63c7b6c6c620325ceddcf372c732"} Jul 22 02:45:00.777351 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:00.777303 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-12ff7d8c-29744805-qsrj7" podStartSLOduration=0.777289133 podStartE2EDuration="777.289133ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:45:00.775501445 +0000 UTC m=+1701.883920783" watchObservedRunningTime="2026-07-22 02:45:00.777289133 +0000 UTC m=+1701.885708468" Jul 22 02:45:01.760767 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:01.760733 2556 generic.go:356] "Generic (PLEG): container finished" podID="37bfabd4-e8e3-4cc9-a14b-5d2f3b4bb6d1" containerID="2c80817712e912013b8c3e001c1d755e4f42e27f4c930ad00764046e555400af" exitCode=0 Jul 22 02:45:01.761175 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:01.760816 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744805-2csrn" event={"ID":"37bfabd4-e8e3-4cc9-a14b-5d2f3b4bb6d1","Type":"ContainerDied","Data":"2c80817712e912013b8c3e001c1d755e4f42e27f4c930ad00764046e555400af"} Jul 22 02:45:01.762193 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:01.762165 2556 generic.go:356] "Generic (PLEG): container finished" podID="579b91ad-d72d-4218-a7f1-bc580de1b07d" containerID="6efe97178e9566876581ee3649c2ebbb9bc99625e47d327d218e91cc28bce6bd" exitCode=0 Jul 22 02:45:01.762288 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:01.762246 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-12ff7d8c-29744805-qsrj7" event={"ID":"579b91ad-d72d-4218-a7f1-bc580de1b07d","Type":"ContainerDied","Data":"6efe97178e9566876581ee3649c2ebbb9bc99625e47d327d218e91cc28bce6bd"} Jul 22 02:45:02.921659 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:02.921622 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744805-2csrn" Jul 22 02:45:02.924350 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:02.924329 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-12ff7d8c-29744805-qsrj7" Jul 22 02:45:03.747242 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:03.747196 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-12ff7d8c-29744805-qsrj7"] Jul 22 02:45:03.751293 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:03.751264 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-12ff7d8c-29744805-qsrj7"] Jul 22 02:45:03.773577 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:03.773547 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-12ff7d8c-29744805-qsrj7" Jul 22 02:45:03.773762 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:03.773551 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e256147fa8a929c16dc2c6c11f27c93467c63c7b6c6c620325ceddcf372c732" Jul 22 02:45:03.775073 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:03.775046 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744805-2csrn" event={"ID":"37bfabd4-e8e3-4cc9-a14b-5d2f3b4bb6d1","Type":"ContainerDied","Data":"bd00da8b2e7511e70bd6fed24e031a00835101e6d8f815192d1a49502a785084"} Jul 22 02:45:03.775073 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:03.775072 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744805-2csrn" Jul 22 02:45:03.775309 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:03.775097 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd00da8b2e7511e70bd6fed24e031a00835101e6d8f815192d1a49502a785084" Jul 22 02:45:03.787171 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:45:03.787142 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-e2e-migrate-12ff7d8c-29744805-qsrj7\" is forbidden: User \"system:node:ip-10-0-137-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-137-41.ec2.internal' and this object" podUID="579b91ad-d72d-4218-a7f1-bc580de1b07d" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-12ff7d8c-29744805-qsrj7" Jul 22 02:45:03.795106 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:45:03.795078 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-e2e-migrate-12ff7d8c-29744805-qsrj7\" is forbidden: User \"system:node:ip-10-0-137-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-137-41.ec2.internal' and this object" podUID="579b91ad-d72d-4218-a7f1-bc580de1b07d" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-12ff7d8c-29744805-qsrj7" Jul 22 02:45:04.255995 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:04.255962 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="579b91ad-d72d-4218-a7f1-bc580de1b07d" path="/var/lib/kubelet/pods/579b91ad-d72d-4218-a7f1-bc580de1b07d/volumes" Jul 22 02:45:08.192086 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:08.192048 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-12ff7d8c-9qxvc"] Jul 22 02:45:08.194345 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:08.194320 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-12ff7d8c-9qxvc"] Jul 22 02:45:08.254910 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:08.254878 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c34661f9-adb3-47c7-8af5-d682324a6790" path="/var/lib/kubelet/pods/c34661f9-adb3-47c7-8af5-d682324a6790/volumes" Jul 22 02:45:08.334706 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:08.334671 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk"] Jul 22 02:45:08.334893 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:08.334872 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" podUID="1800cad2-f3f9-41db-98f1-ac1d85e125e9" containerName="istio-proxy" containerID="cri-o://e50c509f18849a35822e461aefccd33abc67e2288833fe22bf73182928fcd202" gracePeriod=30 Jul 22 02:45:09.141504 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.141469 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6"] Jul 22 02:45:09.141873 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.141860 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37bfabd4-e8e3-4cc9-a14b-5d2f3b4bb6d1" containerName="cleanup" Jul 22 02:45:09.141930 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.141875 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="37bfabd4-e8e3-4cc9-a14b-5d2f3b4bb6d1" containerName="cleanup" Jul 22 02:45:09.141930 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.141893 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579b91ad-d72d-4218-a7f1-bc580de1b07d" containerName="cleanup" Jul 22 02:45:09.141930 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.141899 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="579b91ad-d72d-4218-a7f1-bc580de1b07d" containerName="cleanup" Jul 22 02:45:09.142035 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.141955 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="579b91ad-d72d-4218-a7f1-bc580de1b07d" containerName="cleanup" Jul 22 02:45:09.142035 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.141966 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="37bfabd4-e8e3-4cc9-a14b-5d2f3b4bb6d1" containerName="cleanup" Jul 22 02:45:09.145293 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.145268 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.149231 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.149209 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e4b39588-openshift-default-dockercfg-692v4\"" Jul 22 02:45:09.168743 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.168713 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6"] Jul 22 02:45:09.178453 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.178420 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-data\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.178630 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.178485 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-workload-socket\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.178630 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.178539 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-credential-socket\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.178630 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.178578 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-token\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.178809 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.178676 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-workload-certs\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.178809 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.178696 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-envoy\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.178809 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.178712 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75d90ed6-aa24-4568-9829-deaddf60c3d4-istiod-ca-cert\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.178809 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.178727 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rh6d\" (UniqueName: \"kubernetes.io/projected/75d90ed6-aa24-4568-9829-deaddf60c3d4-kube-api-access-8rh6d\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.178809 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.178748 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-podinfo\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.279871 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.279830 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-workload-socket\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.279871 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.279875 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-credential-socket\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.280406 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.279903 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-token\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.280406 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.279968 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-workload-certs\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.280406 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.279994 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-envoy\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.280406 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.280204 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75d90ed6-aa24-4568-9829-deaddf60c3d4-istiod-ca-cert\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.280406 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.280255 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rh6d\" (UniqueName: \"kubernetes.io/projected/75d90ed6-aa24-4568-9829-deaddf60c3d4-kube-api-access-8rh6d\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.280406 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.280304 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-podinfo\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.280406 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.280308 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-credential-socket\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.280406 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.280336 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-workload-socket\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.280406 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.280391 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-data\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.280931 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.280727 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-workload-certs\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.280931 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.280785 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-data\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.281000 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.280932 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75d90ed6-aa24-4568-9829-deaddf60c3d4-istiod-ca-cert\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.282423 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.282401 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-envoy\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.282911 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.282895 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-podinfo\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.290533 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.290499 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-token\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.290672 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.290601 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rh6d\" (UniqueName: \"kubernetes.io/projected/75d90ed6-aa24-4568-9829-deaddf60c3d4-kube-api-access-8rh6d\") pod \"e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.455579 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.455533 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:09.603325 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.603299 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6"] Jul 22 02:45:09.604635 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:45:09.604610 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75d90ed6_aa24_4568_9829_deaddf60c3d4.slice/crio-abd7fc501680c1cd54ea1b1f9b78dadaf14de76bbdd5837cbbdccee2d3f0b736 WatchSource:0}: Error finding container abd7fc501680c1cd54ea1b1f9b78dadaf14de76bbdd5837cbbdccee2d3f0b736: Status 404 returned error can't find the container with id abd7fc501680c1cd54ea1b1f9b78dadaf14de76bbdd5837cbbdccee2d3f0b736 Jul 22 02:45:09.606630 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.606598 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:45:09.606736 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.606687 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:45:09.606736 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.606716 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:45:09.810130 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.810040 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" event={"ID":"75d90ed6-aa24-4568-9829-deaddf60c3d4","Type":"ContainerStarted","Data":"b18d96b01a66f98f27509ca242e7c703a4a68911023c57e1f73fe34e50524db7"} Jul 22 02:45:09.810130 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:09.810094 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" event={"ID":"75d90ed6-aa24-4568-9829-deaddf60c3d4","Type":"ContainerStarted","Data":"abd7fc501680c1cd54ea1b1f9b78dadaf14de76bbdd5837cbbdccee2d3f0b736"} Jul 22 02:45:10.455894 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:10.455853 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:10.460946 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:10.460917 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:10.487790 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:10.487734 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" podStartSLOduration=1.4877177050000001 podStartE2EDuration="1.487717705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:45:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:45:09.854755976 +0000 UTC m=+1710.963175333" watchObservedRunningTime="2026-07-22 02:45:10.487717705 +0000 UTC m=+1711.596137136" Jul 22 02:45:10.815507 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:10.815407 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:10.816283 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:10.816263 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:13.592737 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.592711 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:45:13.621140 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.621058 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-data\") pod \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " Jul 22 02:45:13.621140 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.621115 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-podinfo\") pod \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " Jul 22 02:45:13.621140 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.621136 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-workload-certs\") pod \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " Jul 22 02:45:13.621391 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.621151 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-credential-socket\") pod \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " Jul 22 02:45:13.621391 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.621199 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-workload-socket\") pod \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " Jul 22 02:45:13.621391 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.621217 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istiod-ca-cert\") pod \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " Jul 22 02:45:13.621391 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.621236 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-envoy\") pod \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " Jul 22 02:45:13.621391 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.621269 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4626p\" (UniqueName: \"kubernetes.io/projected/1800cad2-f3f9-41db-98f1-ac1d85e125e9-kube-api-access-4626p\") pod \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " Jul 22 02:45:13.621391 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.621371 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-token\") pod \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\" (UID: \"1800cad2-f3f9-41db-98f1-ac1d85e125e9\") " Jul 22 02:45:13.621712 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.621584 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1800cad2-f3f9-41db-98f1-ac1d85e125e9" (UID: "1800cad2-f3f9-41db-98f1-ac1d85e125e9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:45:13.621712 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.621661 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1800cad2-f3f9-41db-98f1-ac1d85e125e9" (UID: "1800cad2-f3f9-41db-98f1-ac1d85e125e9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:45:13.621905 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.621883 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1800cad2-f3f9-41db-98f1-ac1d85e125e9" (UID: "1800cad2-f3f9-41db-98f1-ac1d85e125e9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:45:13.622072 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.622025 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-data" (OuterVolumeSpecName: "istio-data") pod "1800cad2-f3f9-41db-98f1-ac1d85e125e9" (UID: "1800cad2-f3f9-41db-98f1-ac1d85e125e9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:45:13.622325 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.622182 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1800cad2-f3f9-41db-98f1-ac1d85e125e9" (UID: "1800cad2-f3f9-41db-98f1-ac1d85e125e9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:45:13.623969 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.623918 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1800cad2-f3f9-41db-98f1-ac1d85e125e9" (UID: "1800cad2-f3f9-41db-98f1-ac1d85e125e9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 02:45:13.624086 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.624025 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-token" (OuterVolumeSpecName: "istio-token") pod "1800cad2-f3f9-41db-98f1-ac1d85e125e9" (UID: "1800cad2-f3f9-41db-98f1-ac1d85e125e9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:45:13.624086 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.624043 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1800cad2-f3f9-41db-98f1-ac1d85e125e9-kube-api-access-4626p" (OuterVolumeSpecName: "kube-api-access-4626p") pod "1800cad2-f3f9-41db-98f1-ac1d85e125e9" (UID: "1800cad2-f3f9-41db-98f1-ac1d85e125e9"). InnerVolumeSpecName "kube-api-access-4626p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:45:13.624383 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.624343 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1800cad2-f3f9-41db-98f1-ac1d85e125e9" (UID: "1800cad2-f3f9-41db-98f1-ac1d85e125e9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:45:13.722737 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.722703 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-token\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:45:13.722737 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.722732 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-data\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:45:13.722737 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.722741 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-podinfo\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:45:13.722737 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.722750 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-workload-certs\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:45:13.723009 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.722758 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-credential-socket\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:45:13.723009 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.722768 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-workload-socket\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:45:13.723009 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.722778 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istiod-ca-cert\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:45:13.723009 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.722786 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1800cad2-f3f9-41db-98f1-ac1d85e125e9-istio-envoy\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:45:13.723009 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.722793 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4626p\" (UniqueName: \"kubernetes.io/projected/1800cad2-f3f9-41db-98f1-ac1d85e125e9-kube-api-access-4626p\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:45:13.841316 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.841280 2556 generic.go:356] "Generic (PLEG): container finished" podID="1800cad2-f3f9-41db-98f1-ac1d85e125e9" containerID="e50c509f18849a35822e461aefccd33abc67e2288833fe22bf73182928fcd202" exitCode=0 Jul 22 02:45:13.841497 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.841323 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" Jul 22 02:45:13.841497 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.841346 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" event={"ID":"1800cad2-f3f9-41db-98f1-ac1d85e125e9","Type":"ContainerDied","Data":"e50c509f18849a35822e461aefccd33abc67e2288833fe22bf73182928fcd202"} Jul 22 02:45:13.841497 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.841397 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk" event={"ID":"1800cad2-f3f9-41db-98f1-ac1d85e125e9","Type":"ContainerDied","Data":"3f209eedd30454c5817f19e95c27379624702a2a0e7f2c3e5dbb1c01584d9c49"} Jul 22 02:45:13.841497 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.841429 2556 scope.go:117] "RemoveContainer" containerID="e50c509f18849a35822e461aefccd33abc67e2288833fe22bf73182928fcd202" Jul 22 02:45:13.850823 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.850803 2556 scope.go:117] "RemoveContainer" containerID="807d3426f2f8b585ed5f988624de87218dc9a93f8107bbe1e4416147e9ee7f5b" Jul 22 02:45:13.859332 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.859311 2556 scope.go:117] "RemoveContainer" containerID="e50c509f18849a35822e461aefccd33abc67e2288833fe22bf73182928fcd202" Jul 22 02:45:13.859592 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:45:13.859570 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e50c509f18849a35822e461aefccd33abc67e2288833fe22bf73182928fcd202\": container with ID starting with e50c509f18849a35822e461aefccd33abc67e2288833fe22bf73182928fcd202 not found: ID does not exist" containerID="e50c509f18849a35822e461aefccd33abc67e2288833fe22bf73182928fcd202" Jul 22 02:45:13.859629 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.859603 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e50c509f18849a35822e461aefccd33abc67e2288833fe22bf73182928fcd202"} err="failed to get container status \"e50c509f18849a35822e461aefccd33abc67e2288833fe22bf73182928fcd202\": rpc error: code = NotFound desc = could not find container \"e50c509f18849a35822e461aefccd33abc67e2288833fe22bf73182928fcd202\": container with ID starting with e50c509f18849a35822e461aefccd33abc67e2288833fe22bf73182928fcd202 not found: ID does not exist" Jul 22 02:45:13.859629 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.859627 2556 scope.go:117] "RemoveContainer" containerID="807d3426f2f8b585ed5f988624de87218dc9a93f8107bbe1e4416147e9ee7f5b" Jul 22 02:45:13.859915 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:45:13.859898 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"807d3426f2f8b585ed5f988624de87218dc9a93f8107bbe1e4416147e9ee7f5b\": container with ID starting with 807d3426f2f8b585ed5f988624de87218dc9a93f8107bbe1e4416147e9ee7f5b not found: ID does not exist" containerID="807d3426f2f8b585ed5f988624de87218dc9a93f8107bbe1e4416147e9ee7f5b" Jul 22 02:45:13.859965 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.859921 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"807d3426f2f8b585ed5f988624de87218dc9a93f8107bbe1e4416147e9ee7f5b"} err="failed to get container status \"807d3426f2f8b585ed5f988624de87218dc9a93f8107bbe1e4416147e9ee7f5b\": rpc error: code = NotFound desc = could not find container \"807d3426f2f8b585ed5f988624de87218dc9a93f8107bbe1e4416147e9ee7f5b\": container with ID starting with 807d3426f2f8b585ed5f988624de87218dc9a93f8107bbe1e4416147e9ee7f5b not found: ID does not exist" Jul 22 02:45:13.873597 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.873532 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk"] Jul 22 02:45:13.877686 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:13.877662 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-12ff7d8c-gw-openshift-default-6f774cc7b7-798vk"] Jul 22 02:45:14.254459 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:14.254421 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1800cad2-f3f9-41db-98f1-ac1d85e125e9" path="/var/lib/kubelet/pods/1800cad2-f3f9-41db-98f1-ac1d85e125e9/volumes" Jul 22 02:45:26.738539 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:26.737456 2556 patch_prober.go:28] interesting pod/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": read tcp 10.133.0.2:44428->10.133.0.43:15021: read: connection reset by peer" start-of-body= Jul 22 02:45:26.738539 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:26.737542 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" podUID="75d90ed6-aa24-4568-9829-deaddf60c3d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": read tcp 10.133.0.2:44428->10.133.0.43:15021: read: connection reset by peer" Jul 22 02:45:26.914972 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:26.914887 2556 generic.go:356] "Generic (PLEG): container finished" podID="75d90ed6-aa24-4568-9829-deaddf60c3d4" containerID="b18d96b01a66f98f27509ca242e7c703a4a68911023c57e1f73fe34e50524db7" exitCode=0 Jul 22 02:45:26.914972 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:26.914955 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" event={"ID":"75d90ed6-aa24-4568-9829-deaddf60c3d4","Type":"ContainerDied","Data":"b18d96b01a66f98f27509ca242e7c703a4a68911023c57e1f73fe34e50524db7"} Jul 22 02:45:26.915377 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:26.915363 2556 scope.go:117] "RemoveContainer" containerID="b18d96b01a66f98f27509ca242e7c703a4a68911023c57e1f73fe34e50524db7" Jul 22 02:45:26.916423 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:26.916392 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:45:26.916540 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:26.916477 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:45:26.916540 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:26.916522 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:45:27.923312 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:27.923275 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" event={"ID":"75d90ed6-aa24-4568-9829-deaddf60c3d4","Type":"ContainerStarted","Data":"1dc5d1600ee9593877660eeb2b3349c5f71d02c03f54d2e6055f094cba92af72"} Jul 22 02:45:28.456471 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:28.456428 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:28.456799 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:28.456770 2556 patch_prober.go:28] interesting pod/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 22 02:45:28.456885 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:28.456828 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" podUID="75d90ed6-aa24-4568-9829-deaddf60c3d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 22 02:45:29.456479 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:29.456444 2556 patch_prober.go:28] interesting pod/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 22 02:45:29.456892 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:29.456502 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" podUID="75d90ed6-aa24-4568-9829-deaddf60c3d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 22 02:45:30.456871 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:30.456824 2556 patch_prober.go:28] interesting pod/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 22 02:45:30.457284 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:30.456902 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" podUID="75d90ed6-aa24-4568-9829-deaddf60c3d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 22 02:45:31.456388 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:31.456347 2556 patch_prober.go:28] interesting pod/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 22 02:45:31.456573 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:31.456413 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" podUID="75d90ed6-aa24-4568-9829-deaddf60c3d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 22 02:45:32.460165 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:32.460134 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:32.460531 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:32.460393 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:32.461214 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:32.461198 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:37.078740 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:37.078706 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4b39588-2778d"] Jul 22 02:45:37.079317 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:37.079288 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1800cad2-f3f9-41db-98f1-ac1d85e125e9" containerName="istio-proxy" Jul 22 02:45:37.079317 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:37.079307 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1800cad2-f3f9-41db-98f1-ac1d85e125e9" containerName="istio-proxy" Jul 22 02:45:37.079448 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:37.079335 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1800cad2-f3f9-41db-98f1-ac1d85e125e9" containerName="istio-proxy" Jul 22 02:45:37.079448 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:37.079344 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1800cad2-f3f9-41db-98f1-ac1d85e125e9" containerName="istio-proxy" Jul 22 02:45:37.079448 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:37.079445 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1800cad2-f3f9-41db-98f1-ac1d85e125e9" containerName="istio-proxy" Jul 22 02:45:37.079595 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:37.079459 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1800cad2-f3f9-41db-98f1-ac1d85e125e9" containerName="istio-proxy" Jul 22 02:45:37.082742 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:37.082720 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4b39588-2778d" Jul 22 02:45:37.087607 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:37.087585 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rt9zm\"" Jul 22 02:45:37.087859 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:37.087840 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 02:45:37.094661 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:37.094600 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4b39588-2778d"] Jul 22 02:45:37.241266 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:37.241232 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5280054-4716-48b3-9130-427e9dd5bb06-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e4b39588-2778d\" (UID: \"e5280054-4716-48b3-9130-427e9dd5bb06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4b39588-2778d" Jul 22 02:45:37.342843 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:37.342756 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5280054-4716-48b3-9130-427e9dd5bb06-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e4b39588-2778d\" (UID: \"e5280054-4716-48b3-9130-427e9dd5bb06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4b39588-2778d" Jul 22 02:45:37.343397 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:37.343378 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5280054-4716-48b3-9130-427e9dd5bb06-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e4b39588-2778d\" (UID: \"e5280054-4716-48b3-9130-427e9dd5bb06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4b39588-2778d" Jul 22 02:45:37.392780 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:37.392744 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4b39588-2778d" Jul 22 02:45:37.536510 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:37.536486 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4b39588-2778d"] Jul 22 02:45:37.537995 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:45:37.537968 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5280054_4716_48b3_9130_427e9dd5bb06.slice/crio-4be0a8e94b06f0dfe01577c5a8d81dd21be869c2df17caa3f4a27a1d713008f7 WatchSource:0}: Error finding container 4be0a8e94b06f0dfe01577c5a8d81dd21be869c2df17caa3f4a27a1d713008f7: Status 404 returned error can't find the container with id 4be0a8e94b06f0dfe01577c5a8d81dd21be869c2df17caa3f4a27a1d713008f7 Jul 22 02:45:38.007296 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:38.007180 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4b39588-2778d" event={"ID":"e5280054-4716-48b3-9130-427e9dd5bb06","Type":"ContainerStarted","Data":"47182a2366c66b0b704a444c2704f0f699dda13f7d01d3ea57f7e7c521d63682"} Jul 22 02:45:38.007296 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:38.007246 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4b39588-2778d" event={"ID":"e5280054-4716-48b3-9130-427e9dd5bb06","Type":"ContainerStarted","Data":"4be0a8e94b06f0dfe01577c5a8d81dd21be869c2df17caa3f4a27a1d713008f7"} Jul 22 02:45:38.043783 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:38.043728 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4b39588-2778d" podStartSLOduration=1.043713153 podStartE2EDuration="1.043713153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:45:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:45:38.041876833 +0000 UTC m=+1739.150296168" watchObservedRunningTime="2026-07-22 02:45:38.043713153 +0000 UTC m=+1739.152132489" Jul 22 02:45:39.014612 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:39.014579 2556 generic.go:356] "Generic (PLEG): container finished" podID="e5280054-4716-48b3-9130-427e9dd5bb06" containerID="47182a2366c66b0b704a444c2704f0f699dda13f7d01d3ea57f7e7c521d63682" exitCode=0 Jul 22 02:45:39.015013 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:39.014633 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4b39588-2778d" event={"ID":"e5280054-4716-48b3-9130-427e9dd5bb06","Type":"ContainerDied","Data":"47182a2366c66b0b704a444c2704f0f699dda13f7d01d3ea57f7e7c521d63682"} Jul 22 02:45:40.146704 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:40.146680 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4b39588-2778d" Jul 22 02:45:40.268945 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:40.268918 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5280054-4716-48b3-9130-427e9dd5bb06-maas-api-service-ca\") pod \"e5280054-4716-48b3-9130-427e9dd5bb06\" (UID: \"e5280054-4716-48b3-9130-427e9dd5bb06\") " Jul 22 02:45:40.269260 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:40.269238 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5280054-4716-48b3-9130-427e9dd5bb06-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e5280054-4716-48b3-9130-427e9dd5bb06" (UID: "e5280054-4716-48b3-9130-427e9dd5bb06"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:45:40.370553 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:40.370470 2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5280054-4716-48b3-9130-427e9dd5bb06-maas-api-service-ca\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:45:41.026379 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:41.026352 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4b39588-2778d" Jul 22 02:45:41.026555 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:41.026352 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4b39588-2778d" event={"ID":"e5280054-4716-48b3-9130-427e9dd5bb06","Type":"ContainerDied","Data":"4be0a8e94b06f0dfe01577c5a8d81dd21be869c2df17caa3f4a27a1d713008f7"} Jul 22 02:45:41.026555 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:41.026483 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4be0a8e94b06f0dfe01577c5a8d81dd21be869c2df17caa3f4a27a1d713008f7" Jul 22 02:45:52.172536 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:52.172499 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4b39588-2778d"] Jul 22 02:45:52.178813 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:52.178785 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4b39588-2778d"] Jul 22 02:45:52.254481 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:52.254449 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5280054-4716-48b3-9130-427e9dd5bb06" path="/var/lib/kubelet/pods/e5280054-4716-48b3-9130-427e9dd5bb06/volumes" Jul 22 02:45:53.400129 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:53.400095 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6"] Jul 22 02:45:53.400545 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:53.400342 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" podUID="75d90ed6-aa24-4568-9829-deaddf60c3d4" containerName="istio-proxy" containerID="cri-o://1dc5d1600ee9593877660eeb2b3349c5f71d02c03f54d2e6055f094cba92af72" gracePeriod=30 Jul 22 02:45:54.208896 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.208861 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4"] Jul 22 02:45:54.209221 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.209208 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5280054-4716-48b3-9130-427e9dd5bb06" containerName="revoke-keys" Jul 22 02:45:54.209273 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.209222 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5280054-4716-48b3-9130-427e9dd5bb06" containerName="revoke-keys" Jul 22 02:45:54.209311 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.209290 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5280054-4716-48b3-9130-427e9dd5bb06" containerName="revoke-keys" Jul 22 02:45:54.212396 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.212379 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.216824 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.216804 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-fbf4b46e-openshift-default-dockercfg-krfhh\"" Jul 22 02:45:54.235606 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.235578 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4"] Jul 22 02:45:54.292101 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.292068 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-podinfo\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.292374 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.292347 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfz9k\" (UniqueName: \"kubernetes.io/projected/e350cfff-1760-46ec-8b3f-dd2255c01e90-kube-api-access-lfz9k\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.292513 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.292395 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-credential-socket\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.292513 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.292431 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-workload-socket\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.292513 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.292476 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e350cfff-1760-46ec-8b3f-dd2255c01e90-istiod-ca-cert\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.292713 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.292555 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-envoy\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.292713 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.292579 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-data\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.292713 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.292618 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-token\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.292835 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.292713 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-workload-certs\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.393239 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.393195 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-token\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.393239 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.393247 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-workload-certs\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.393505 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.393292 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-podinfo\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.393505 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.393319 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfz9k\" (UniqueName: \"kubernetes.io/projected/e350cfff-1760-46ec-8b3f-dd2255c01e90-kube-api-access-lfz9k\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.393505 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.393343 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-credential-socket\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.393505 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.393363 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-workload-socket\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.393505 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.393423 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e350cfff-1760-46ec-8b3f-dd2255c01e90-istiod-ca-cert\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.393505 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.393480 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-envoy\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.393918 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.393506 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-data\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.393918 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.393798 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-workload-certs\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.393918 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.393811 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-credential-socket\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.393918 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.393834 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-workload-socket\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.394101 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.393951 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-data\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.394226 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.394200 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e350cfff-1760-46ec-8b3f-dd2255c01e90-istiod-ca-cert\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.395755 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.395735 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-envoy\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.395933 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.395915 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-podinfo\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.405627 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.405593 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfz9k\" (UniqueName: \"kubernetes.io/projected/e350cfff-1760-46ec-8b3f-dd2255c01e90-kube-api-access-lfz9k\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.406040 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.406022 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-token\") pod \"e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.522106 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.522018 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:54.694359 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.694329 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4"] Jul 22 02:45:54.695740 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:45:54.695720 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode350cfff_1760_46ec_8b3f_dd2255c01e90.slice/crio-ef0385f94bb042da6a5c7ea85337dd51e909739d3812ebac8d0e6cdbe7010364 WatchSource:0}: Error finding container ef0385f94bb042da6a5c7ea85337dd51e909739d3812ebac8d0e6cdbe7010364: Status 404 returned error can't find the container with id ef0385f94bb042da6a5c7ea85337dd51e909739d3812ebac8d0e6cdbe7010364 Jul 22 02:45:54.697790 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.697760 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:45:54.697852 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.697825 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:45:54.697889 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:54.697859 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:45:55.117980 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:55.117943 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" event={"ID":"e350cfff-1760-46ec-8b3f-dd2255c01e90","Type":"ContainerStarted","Data":"678296df19ec7a394d52e49c7de214a94f8e200be3fe78101c356b54eb645b10"} Jul 22 02:45:55.118186 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:55.118017 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" event={"ID":"e350cfff-1760-46ec-8b3f-dd2255c01e90","Type":"ContainerStarted","Data":"ef0385f94bb042da6a5c7ea85337dd51e909739d3812ebac8d0e6cdbe7010364"} Jul 22 02:45:55.153596 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:55.153527 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" podStartSLOduration=1.153509066 podStartE2EDuration="1.153509066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:45:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:45:55.152048694 +0000 UTC m=+1756.260468031" watchObservedRunningTime="2026-07-22 02:45:55.153509066 +0000 UTC m=+1756.261928403" Jul 22 02:45:55.522742 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:55.522704 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:55.528251 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:55.528228 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:56.124527 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:56.124495 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:56.125375 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:56.125357 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:45:58.641248 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.641224 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:58.730975 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.730942 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-envoy\") pod \"75d90ed6-aa24-4568-9829-deaddf60c3d4\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " Jul 22 02:45:58.731167 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.730998 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-workload-socket\") pod \"75d90ed6-aa24-4568-9829-deaddf60c3d4\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " Jul 22 02:45:58.731167 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.731021 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-credential-socket\") pod \"75d90ed6-aa24-4568-9829-deaddf60c3d4\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " Jul 22 02:45:58.731167 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.731064 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-data\") pod \"75d90ed6-aa24-4568-9829-deaddf60c3d4\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " Jul 22 02:45:58.731167 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.731090 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-podinfo\") pod \"75d90ed6-aa24-4568-9829-deaddf60c3d4\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " Jul 22 02:45:58.731167 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.731115 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-token\") pod \"75d90ed6-aa24-4568-9829-deaddf60c3d4\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " Jul 22 02:45:58.731167 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.731151 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-workload-certs\") pod \"75d90ed6-aa24-4568-9829-deaddf60c3d4\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " Jul 22 02:45:58.731477 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.731201 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75d90ed6-aa24-4568-9829-deaddf60c3d4-istiod-ca-cert\") pod \"75d90ed6-aa24-4568-9829-deaddf60c3d4\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " Jul 22 02:45:58.731477 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.731255 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rh6d\" (UniqueName: \"kubernetes.io/projected/75d90ed6-aa24-4568-9829-deaddf60c3d4-kube-api-access-8rh6d\") pod \"75d90ed6-aa24-4568-9829-deaddf60c3d4\" (UID: \"75d90ed6-aa24-4568-9829-deaddf60c3d4\") " Jul 22 02:45:58.731477 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.731296 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "75d90ed6-aa24-4568-9829-deaddf60c3d4" (UID: "75d90ed6-aa24-4568-9829-deaddf60c3d4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:45:58.731477 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.731407 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "75d90ed6-aa24-4568-9829-deaddf60c3d4" (UID: "75d90ed6-aa24-4568-9829-deaddf60c3d4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:45:58.731729 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.731526 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "75d90ed6-aa24-4568-9829-deaddf60c3d4" (UID: "75d90ed6-aa24-4568-9829-deaddf60c3d4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:45:58.731729 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.731664 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-workload-socket\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:45:58.731729 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.731687 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-credential-socket\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:45:58.731729 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.731700 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-workload-certs\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:45:58.731954 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.731770 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75d90ed6-aa24-4568-9829-deaddf60c3d4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "75d90ed6-aa24-4568-9829-deaddf60c3d4" (UID: "75d90ed6-aa24-4568-9829-deaddf60c3d4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:45:58.732093 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.732074 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-data" (OuterVolumeSpecName: "istio-data") pod "75d90ed6-aa24-4568-9829-deaddf60c3d4" (UID: "75d90ed6-aa24-4568-9829-deaddf60c3d4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:45:58.733341 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.733317 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "75d90ed6-aa24-4568-9829-deaddf60c3d4" (UID: "75d90ed6-aa24-4568-9829-deaddf60c3d4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 02:45:58.733499 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.733483 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75d90ed6-aa24-4568-9829-deaddf60c3d4-kube-api-access-8rh6d" (OuterVolumeSpecName: "kube-api-access-8rh6d") pod "75d90ed6-aa24-4568-9829-deaddf60c3d4" (UID: "75d90ed6-aa24-4568-9829-deaddf60c3d4"). InnerVolumeSpecName "kube-api-access-8rh6d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:45:58.733597 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.733577 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "75d90ed6-aa24-4568-9829-deaddf60c3d4" (UID: "75d90ed6-aa24-4568-9829-deaddf60c3d4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:45:58.733685 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.733618 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-token" (OuterVolumeSpecName: "istio-token") pod "75d90ed6-aa24-4568-9829-deaddf60c3d4" (UID: "75d90ed6-aa24-4568-9829-deaddf60c3d4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:45:58.832985 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.832952 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75d90ed6-aa24-4568-9829-deaddf60c3d4-istiod-ca-cert\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:45:58.832985 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.832982 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rh6d\" (UniqueName: \"kubernetes.io/projected/75d90ed6-aa24-4568-9829-deaddf60c3d4-kube-api-access-8rh6d\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:45:58.832985 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.832996 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-envoy\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:45:58.833262 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.833005 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-data\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:45:58.833262 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.833013 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-podinfo\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:45:58.833262 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:58.833021 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75d90ed6-aa24-4568-9829-deaddf60c3d4-istio-token\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:45:59.143382 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:59.143288 2556 generic.go:356] "Generic (PLEG): container finished" podID="75d90ed6-aa24-4568-9829-deaddf60c3d4" containerID="1dc5d1600ee9593877660eeb2b3349c5f71d02c03f54d2e6055f094cba92af72" exitCode=0 Jul 22 02:45:59.143382 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:59.143327 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" event={"ID":"75d90ed6-aa24-4568-9829-deaddf60c3d4","Type":"ContainerDied","Data":"1dc5d1600ee9593877660eeb2b3349c5f71d02c03f54d2e6055f094cba92af72"} Jul 22 02:45:59.143382 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:59.143341 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" Jul 22 02:45:59.143382 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:59.143371 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6" event={"ID":"75d90ed6-aa24-4568-9829-deaddf60c3d4","Type":"ContainerDied","Data":"abd7fc501680c1cd54ea1b1f9b78dadaf14de76bbdd5837cbbdccee2d3f0b736"} Jul 22 02:45:59.143775 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:59.143392 2556 scope.go:117] "RemoveContainer" containerID="1dc5d1600ee9593877660eeb2b3349c5f71d02c03f54d2e6055f094cba92af72" Jul 22 02:45:59.152399 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:59.152383 2556 scope.go:117] "RemoveContainer" containerID="b18d96b01a66f98f27509ca242e7c703a4a68911023c57e1f73fe34e50524db7" Jul 22 02:45:59.160619 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:59.160598 2556 scope.go:117] "RemoveContainer" containerID="1dc5d1600ee9593877660eeb2b3349c5f71d02c03f54d2e6055f094cba92af72" Jul 22 02:45:59.160870 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:45:59.160849 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dc5d1600ee9593877660eeb2b3349c5f71d02c03f54d2e6055f094cba92af72\": container with ID starting with 1dc5d1600ee9593877660eeb2b3349c5f71d02c03f54d2e6055f094cba92af72 not found: ID does not exist" containerID="1dc5d1600ee9593877660eeb2b3349c5f71d02c03f54d2e6055f094cba92af72" Jul 22 02:45:59.160918 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:59.160880 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dc5d1600ee9593877660eeb2b3349c5f71d02c03f54d2e6055f094cba92af72"} err="failed to get container status \"1dc5d1600ee9593877660eeb2b3349c5f71d02c03f54d2e6055f094cba92af72\": rpc error: code = NotFound desc = could not find container \"1dc5d1600ee9593877660eeb2b3349c5f71d02c03f54d2e6055f094cba92af72\": container with ID starting with 1dc5d1600ee9593877660eeb2b3349c5f71d02c03f54d2e6055f094cba92af72 not found: ID does not exist" Jul 22 02:45:59.160918 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:59.160896 2556 scope.go:117] "RemoveContainer" containerID="b18d96b01a66f98f27509ca242e7c703a4a68911023c57e1f73fe34e50524db7" Jul 22 02:45:59.161143 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:45:59.161119 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b18d96b01a66f98f27509ca242e7c703a4a68911023c57e1f73fe34e50524db7\": container with ID starting with b18d96b01a66f98f27509ca242e7c703a4a68911023c57e1f73fe34e50524db7 not found: ID does not exist" containerID="b18d96b01a66f98f27509ca242e7c703a4a68911023c57e1f73fe34e50524db7" Jul 22 02:45:59.161244 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:59.161146 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18d96b01a66f98f27509ca242e7c703a4a68911023c57e1f73fe34e50524db7"} err="failed to get container status \"b18d96b01a66f98f27509ca242e7c703a4a68911023c57e1f73fe34e50524db7\": rpc error: code = NotFound desc = could not find container \"b18d96b01a66f98f27509ca242e7c703a4a68911023c57e1f73fe34e50524db7\": container with ID starting with b18d96b01a66f98f27509ca242e7c703a4a68911023c57e1f73fe34e50524db7 not found: ID does not exist" Jul 22 02:45:59.171921 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:59.171901 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6"] Jul 22 02:45:59.178073 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:45:59.178054 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e4b39588-openshift-default-7669f49679-x5lf6"] Jul 22 02:46:00.255031 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:00.254997 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75d90ed6-aa24-4568-9829-deaddf60c3d4" path="/var/lib/kubelet/pods/75d90ed6-aa24-4568-9829-deaddf60c3d4/volumes" Jul 22 02:46:10.206206 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:10.206170 2556 generic.go:356] "Generic (PLEG): container finished" podID="e350cfff-1760-46ec-8b3f-dd2255c01e90" containerID="678296df19ec7a394d52e49c7de214a94f8e200be3fe78101c356b54eb645b10" exitCode=0 Jul 22 02:46:10.206767 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:10.206242 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" event={"ID":"e350cfff-1760-46ec-8b3f-dd2255c01e90","Type":"ContainerDied","Data":"678296df19ec7a394d52e49c7de214a94f8e200be3fe78101c356b54eb645b10"} Jul 22 02:46:10.206767 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:10.206754 2556 scope.go:117] "RemoveContainer" containerID="678296df19ec7a394d52e49c7de214a94f8e200be3fe78101c356b54eb645b10" Jul 22 02:46:10.207851 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:10.207817 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:46:10.207978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:10.207904 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:46:10.207978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:10.207956 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:46:11.125125 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:11.125087 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:46:11.213786 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:11.213751 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" event={"ID":"e350cfff-1760-46ec-8b3f-dd2255c01e90","Type":"ContainerStarted","Data":"e789920b772d81fdc19800eeb8cbd49aa4e210b4aefbd69493e61df14794ae9d"} Jul 22 02:46:11.522810 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:11.522774 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:46:11.523930 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:11.523902 2556 patch_prober.go:28] interesting pod/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 22 02:46:11.524034 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:11.523955 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" podUID="e350cfff-1760-46ec-8b3f-dd2255c01e90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 22 02:46:12.523265 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:12.523225 2556 patch_prober.go:28] interesting pod/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 22 02:46:12.523671 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:12.523283 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" podUID="e350cfff-1760-46ec-8b3f-dd2255c01e90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 22 02:46:13.522911 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:13.522875 2556 patch_prober.go:28] interesting pod/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 22 02:46:13.523086 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:13.522934 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" podUID="e350cfff-1760-46ec-8b3f-dd2255c01e90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 22 02:46:14.523193 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:14.523153 2556 patch_prober.go:28] interesting pod/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 22 02:46:14.523598 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:14.523225 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" podUID="e350cfff-1760-46ec-8b3f-dd2255c01e90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 22 02:46:15.526495 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:15.526465 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:46:15.526891 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:15.526821 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:46:15.527486 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:15.527471 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:46:21.432501 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:21.432462 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-fbf4b46e-s9zbh"] Jul 22 02:46:21.432988 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:21.432822 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75d90ed6-aa24-4568-9829-deaddf60c3d4" containerName="istio-proxy" Jul 22 02:46:21.432988 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:21.432835 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="75d90ed6-aa24-4568-9829-deaddf60c3d4" containerName="istio-proxy" Jul 22 02:46:21.432988 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:21.432907 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="75d90ed6-aa24-4568-9829-deaddf60c3d4" containerName="istio-proxy" Jul 22 02:46:21.435887 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:21.435869 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-fbf4b46e-s9zbh" Jul 22 02:46:21.438975 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:21.438954 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 02:46:21.439394 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:21.439374 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rt9zm\"" Jul 22 02:46:21.446309 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:21.446284 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-fbf4b46e-s9zbh"] Jul 22 02:46:21.554207 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:21.554169 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a885564-d04f-44c0-a16b-c5d50b7b2d90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-fbf4b46e-s9zbh\" (UID: \"1a885564-d04f-44c0-a16b-c5d50b7b2d90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-fbf4b46e-s9zbh" Jul 22 02:46:21.654978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:21.654941 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a885564-d04f-44c0-a16b-c5d50b7b2d90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-fbf4b46e-s9zbh\" (UID: \"1a885564-d04f-44c0-a16b-c5d50b7b2d90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-fbf4b46e-s9zbh" Jul 22 02:46:21.655589 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:21.655568 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a885564-d04f-44c0-a16b-c5d50b7b2d90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-fbf4b46e-s9zbh\" (UID: \"1a885564-d04f-44c0-a16b-c5d50b7b2d90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-fbf4b46e-s9zbh" Jul 22 02:46:21.746083 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:21.746001 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-fbf4b46e-s9zbh" Jul 22 02:46:21.900444 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:21.900271 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-fbf4b46e-s9zbh"] Jul 22 02:46:21.902679 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:46:21.902635 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a885564_d04f_44c0_a16b_c5d50b7b2d90.slice/crio-180a44e36e0cbcacd5c9204bc00d5006dcce999181e7b1453e93de8a7e7c45a5 WatchSource:0}: Error finding container 180a44e36e0cbcacd5c9204bc00d5006dcce999181e7b1453e93de8a7e7c45a5: Status 404 returned error can't find the container with id 180a44e36e0cbcacd5c9204bc00d5006dcce999181e7b1453e93de8a7e7c45a5 Jul 22 02:46:22.278401 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:22.278365 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-fbf4b46e-s9zbh" event={"ID":"1a885564-d04f-44c0-a16b-c5d50b7b2d90","Type":"ContainerStarted","Data":"8292c4fd3141c2b89df5e8cd660eef7c8e7479295e4ef7ea59911f3241e725e3"} Jul 22 02:46:22.278611 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:22.278424 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-fbf4b46e-s9zbh" event={"ID":"1a885564-d04f-44c0-a16b-c5d50b7b2d90","Type":"ContainerStarted","Data":"180a44e36e0cbcacd5c9204bc00d5006dcce999181e7b1453e93de8a7e7c45a5"} Jul 22 02:46:22.298956 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:22.298892 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-fbf4b46e-s9zbh" podStartSLOduration=1.298874694 podStartE2EDuration="1.298874694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:46:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:46:22.297908061 +0000 UTC m=+1783.406327397" watchObservedRunningTime="2026-07-22 02:46:22.298874694 +0000 UTC m=+1783.407294030" Jul 22 02:46:23.285006 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:23.284972 2556 generic.go:356] "Generic (PLEG): container finished" podID="1a885564-d04f-44c0-a16b-c5d50b7b2d90" containerID="8292c4fd3141c2b89df5e8cd660eef7c8e7479295e4ef7ea59911f3241e725e3" exitCode=0 Jul 22 02:46:23.285383 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:23.285062 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-fbf4b46e-s9zbh" event={"ID":"1a885564-d04f-44c0-a16b-c5d50b7b2d90","Type":"ContainerDied","Data":"8292c4fd3141c2b89df5e8cd660eef7c8e7479295e4ef7ea59911f3241e725e3"} Jul 22 02:46:24.424283 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:24.424254 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-fbf4b46e-s9zbh" Jul 22 02:46:24.582623 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:24.582533 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a885564-d04f-44c0-a16b-c5d50b7b2d90-maas-api-service-ca\") pod \"1a885564-d04f-44c0-a16b-c5d50b7b2d90\" (UID: \"1a885564-d04f-44c0-a16b-c5d50b7b2d90\") " Jul 22 02:46:24.582916 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:24.582892 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a885564-d04f-44c0-a16b-c5d50b7b2d90-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1a885564-d04f-44c0-a16b-c5d50b7b2d90" (UID: "1a885564-d04f-44c0-a16b-c5d50b7b2d90"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:46:24.683389 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:24.683352 2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a885564-d04f-44c0-a16b-c5d50b7b2d90-maas-api-service-ca\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:46:25.300824 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:25.300794 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-fbf4b46e-s9zbh" Jul 22 02:46:25.300824 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:25.300813 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-fbf4b46e-s9zbh" event={"ID":"1a885564-d04f-44c0-a16b-c5d50b7b2d90","Type":"ContainerDied","Data":"180a44e36e0cbcacd5c9204bc00d5006dcce999181e7b1453e93de8a7e7c45a5"} Jul 22 02:46:25.301166 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:25.300855 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="180a44e36e0cbcacd5c9204bc00d5006dcce999181e7b1453e93de8a7e7c45a5" Jul 22 02:46:36.542680 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:36.542582 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-fbf4b46e-s9zbh"] Jul 22 02:46:36.545432 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:36.545410 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-fbf4b46e-s9zbh"] Jul 22 02:46:36.686857 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:36.686822 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4"] Jul 22 02:46:36.687063 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:36.687037 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" podUID="e350cfff-1760-46ec-8b3f-dd2255c01e90" containerName="istio-proxy" containerID="cri-o://e789920b772d81fdc19800eeb8cbd49aa4e210b4aefbd69493e61df14794ae9d" gracePeriod=30 Jul 22 02:46:38.254161 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:38.254122 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a885564-d04f-44c0-a16b-c5d50b7b2d90" path="/var/lib/kubelet/pods/1a885564-d04f-44c0-a16b-c5d50b7b2d90/volumes" Jul 22 02:46:41.937034 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:41.937008 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:46:42.039700 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.039589 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e350cfff-1760-46ec-8b3f-dd2255c01e90-istiod-ca-cert\") pod \"e350cfff-1760-46ec-8b3f-dd2255c01e90\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " Jul 22 02:46:42.039700 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.039624 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-token\") pod \"e350cfff-1760-46ec-8b3f-dd2255c01e90\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " Jul 22 02:46:42.039700 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.039663 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-data\") pod \"e350cfff-1760-46ec-8b3f-dd2255c01e90\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " Jul 22 02:46:42.039700 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.039680 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-workload-certs\") pod \"e350cfff-1760-46ec-8b3f-dd2255c01e90\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " Jul 22 02:46:42.039700 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.039705 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-envoy\") pod \"e350cfff-1760-46ec-8b3f-dd2255c01e90\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " Jul 22 02:46:42.040082 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.039740 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-credential-socket\") pod \"e350cfff-1760-46ec-8b3f-dd2255c01e90\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " Jul 22 02:46:42.040082 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.039824 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfz9k\" (UniqueName: \"kubernetes.io/projected/e350cfff-1760-46ec-8b3f-dd2255c01e90-kube-api-access-lfz9k\") pod \"e350cfff-1760-46ec-8b3f-dd2255c01e90\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " Jul 22 02:46:42.040082 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.039850 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-workload-socket\") pod \"e350cfff-1760-46ec-8b3f-dd2255c01e90\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " Jul 22 02:46:42.040082 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.039920 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-podinfo\") pod \"e350cfff-1760-46ec-8b3f-dd2255c01e90\" (UID: \"e350cfff-1760-46ec-8b3f-dd2255c01e90\") " Jul 22 02:46:42.040082 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.039990 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e350cfff-1760-46ec-8b3f-dd2255c01e90-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e350cfff-1760-46ec-8b3f-dd2255c01e90" (UID: "e350cfff-1760-46ec-8b3f-dd2255c01e90"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:46:42.040082 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.040033 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e350cfff-1760-46ec-8b3f-dd2255c01e90" (UID: "e350cfff-1760-46ec-8b3f-dd2255c01e90"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:46:42.040417 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.040223 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e350cfff-1760-46ec-8b3f-dd2255c01e90-istiod-ca-cert\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:46:42.040417 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.040240 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-workload-certs\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:46:42.040417 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.040278 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e350cfff-1760-46ec-8b3f-dd2255c01e90" (UID: "e350cfff-1760-46ec-8b3f-dd2255c01e90"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:46:42.040587 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.040495 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e350cfff-1760-46ec-8b3f-dd2255c01e90" (UID: "e350cfff-1760-46ec-8b3f-dd2255c01e90"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:46:42.040854 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.040823 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-data" (OuterVolumeSpecName: "istio-data") pod "e350cfff-1760-46ec-8b3f-dd2255c01e90" (UID: "e350cfff-1760-46ec-8b3f-dd2255c01e90"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:46:42.042038 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.042014 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e350cfff-1760-46ec-8b3f-dd2255c01e90" (UID: "e350cfff-1760-46ec-8b3f-dd2255c01e90"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:46:42.042158 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.042114 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-token" (OuterVolumeSpecName: "istio-token") pod "e350cfff-1760-46ec-8b3f-dd2255c01e90" (UID: "e350cfff-1760-46ec-8b3f-dd2255c01e90"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:46:42.042228 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.042158 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e350cfff-1760-46ec-8b3f-dd2255c01e90" (UID: "e350cfff-1760-46ec-8b3f-dd2255c01e90"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 02:46:42.042228 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.042187 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e350cfff-1760-46ec-8b3f-dd2255c01e90-kube-api-access-lfz9k" (OuterVolumeSpecName: "kube-api-access-lfz9k") pod "e350cfff-1760-46ec-8b3f-dd2255c01e90" (UID: "e350cfff-1760-46ec-8b3f-dd2255c01e90"). InnerVolumeSpecName "kube-api-access-lfz9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:46:42.141614 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.141573 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-podinfo\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:46:42.141614 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.141608 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-token\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:46:42.141614 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.141620 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-data\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:46:42.141878 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.141631 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-istio-envoy\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:46:42.141878 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.141665 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-credential-socket\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:46:42.141878 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.141680 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfz9k\" (UniqueName: \"kubernetes.io/projected/e350cfff-1760-46ec-8b3f-dd2255c01e90-kube-api-access-lfz9k\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:46:42.141878 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.141691 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e350cfff-1760-46ec-8b3f-dd2255c01e90-workload-socket\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:46:42.393529 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.393432 2556 generic.go:356] "Generic (PLEG): container finished" podID="e350cfff-1760-46ec-8b3f-dd2255c01e90" containerID="e789920b772d81fdc19800eeb8cbd49aa4e210b4aefbd69493e61df14794ae9d" exitCode=0 Jul 22 02:46:42.393529 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.393479 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" Jul 22 02:46:42.393808 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.393520 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" event={"ID":"e350cfff-1760-46ec-8b3f-dd2255c01e90","Type":"ContainerDied","Data":"e789920b772d81fdc19800eeb8cbd49aa4e210b4aefbd69493e61df14794ae9d"} Jul 22 02:46:42.393808 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.393587 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4" event={"ID":"e350cfff-1760-46ec-8b3f-dd2255c01e90","Type":"ContainerDied","Data":"ef0385f94bb042da6a5c7ea85337dd51e909739d3812ebac8d0e6cdbe7010364"} Jul 22 02:46:42.393808 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.393616 2556 scope.go:117] "RemoveContainer" containerID="e789920b772d81fdc19800eeb8cbd49aa4e210b4aefbd69493e61df14794ae9d" Jul 22 02:46:42.402963 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.402945 2556 scope.go:117] "RemoveContainer" containerID="678296df19ec7a394d52e49c7de214a94f8e200be3fe78101c356b54eb645b10" Jul 22 02:46:42.411730 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.411708 2556 scope.go:117] "RemoveContainer" containerID="e789920b772d81fdc19800eeb8cbd49aa4e210b4aefbd69493e61df14794ae9d" Jul 22 02:46:42.412073 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:46:42.412037 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e789920b772d81fdc19800eeb8cbd49aa4e210b4aefbd69493e61df14794ae9d\": container with ID starting with e789920b772d81fdc19800eeb8cbd49aa4e210b4aefbd69493e61df14794ae9d not found: ID does not exist" containerID="e789920b772d81fdc19800eeb8cbd49aa4e210b4aefbd69493e61df14794ae9d" Jul 22 02:46:42.412174 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.412085 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e789920b772d81fdc19800eeb8cbd49aa4e210b4aefbd69493e61df14794ae9d"} err="failed to get container status \"e789920b772d81fdc19800eeb8cbd49aa4e210b4aefbd69493e61df14794ae9d\": rpc error: code = NotFound desc = could not find container \"e789920b772d81fdc19800eeb8cbd49aa4e210b4aefbd69493e61df14794ae9d\": container with ID starting with e789920b772d81fdc19800eeb8cbd49aa4e210b4aefbd69493e61df14794ae9d not found: ID does not exist" Jul 22 02:46:42.412174 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.412107 2556 scope.go:117] "RemoveContainer" containerID="678296df19ec7a394d52e49c7de214a94f8e200be3fe78101c356b54eb645b10" Jul 22 02:46:42.412460 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:46:42.412425 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"678296df19ec7a394d52e49c7de214a94f8e200be3fe78101c356b54eb645b10\": container with ID starting with 678296df19ec7a394d52e49c7de214a94f8e200be3fe78101c356b54eb645b10 not found: ID does not exist" containerID="678296df19ec7a394d52e49c7de214a94f8e200be3fe78101c356b54eb645b10" Jul 22 02:46:42.412540 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.412460 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"678296df19ec7a394d52e49c7de214a94f8e200be3fe78101c356b54eb645b10"} err="failed to get container status \"678296df19ec7a394d52e49c7de214a94f8e200be3fe78101c356b54eb645b10\": rpc error: code = NotFound desc = could not find container \"678296df19ec7a394d52e49c7de214a94f8e200be3fe78101c356b54eb645b10\": container with ID starting with 678296df19ec7a394d52e49c7de214a94f8e200be3fe78101c356b54eb645b10 not found: ID does not exist" Jul 22 02:46:42.418305 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.418278 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4"] Jul 22 02:46:42.420500 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:42.420479 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-fbf4b46e-openshift-default-649d97c659-kv8v4"] Jul 22 02:46:44.254492 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:46:44.254454 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e350cfff-1760-46ec-8b3f-dd2255c01e90" path="/var/lib/kubelet/pods/e350cfff-1760-46ec-8b3f-dd2255c01e90/volumes" Jul 22 02:48:24.455856 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.455814 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g"] Jul 22 02:48:24.456455 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.456339 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e350cfff-1760-46ec-8b3f-dd2255c01e90" containerName="istio-proxy" Jul 22 02:48:24.456455 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.456359 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e350cfff-1760-46ec-8b3f-dd2255c01e90" containerName="istio-proxy" Jul 22 02:48:24.456455 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.456372 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75d90ed6-aa24-4568-9829-deaddf60c3d4" containerName="istio-proxy" Jul 22 02:48:24.456455 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.456381 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="75d90ed6-aa24-4568-9829-deaddf60c3d4" containerName="istio-proxy" Jul 22 02:48:24.456455 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.456398 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e350cfff-1760-46ec-8b3f-dd2255c01e90" containerName="istio-proxy" Jul 22 02:48:24.456455 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.456406 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e350cfff-1760-46ec-8b3f-dd2255c01e90" containerName="istio-proxy" Jul 22 02:48:24.456455 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.456422 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a885564-d04f-44c0-a16b-c5d50b7b2d90" containerName="revoke-keys" Jul 22 02:48:24.456455 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.456431 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a885564-d04f-44c0-a16b-c5d50b7b2d90" containerName="revoke-keys" Jul 22 02:48:24.456891 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.456533 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="75d90ed6-aa24-4568-9829-deaddf60c3d4" containerName="istio-proxy" Jul 22 02:48:24.456891 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.456547 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e350cfff-1760-46ec-8b3f-dd2255c01e90" containerName="istio-proxy" Jul 22 02:48:24.456891 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.456559 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a885564-d04f-44c0-a16b-c5d50b7b2d90" containerName="revoke-keys" Jul 22 02:48:24.459623 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.459601 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.462532 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.462512 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-699fd371-openshift-default-dockercfg-r7njt\"" Jul 22 02:48:24.490713 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.490685 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g"] Jul 22 02:48:24.568865 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.568821 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-credential-socket\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.568865 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.568866 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-envoy\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.569109 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.568926 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-data\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.569109 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.568952 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-workload-socket\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.569109 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.569016 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dvsk\" (UniqueName: \"kubernetes.io/projected/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-kube-api-access-9dvsk\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.569109 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.569052 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-workload-certs\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.569109 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.569077 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istiod-ca-cert\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.569348 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.569174 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-token\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.569348 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.569247 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-podinfo\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.670650 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.670611 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-token\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.670869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.670722 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-podinfo\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.670869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.670755 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-credential-socket\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.670869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.670776 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-envoy\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.670869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.670817 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-data\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.670869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.670842 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-workload-socket\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.671185 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.670885 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dvsk\" (UniqueName: \"kubernetes.io/projected/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-kube-api-access-9dvsk\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.671185 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.670922 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-workload-certs\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.671185 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.670950 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istiod-ca-cert\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.671362 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.671200 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-credential-socket\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.671362 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.671226 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-data\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.671362 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.671320 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-workload-socket\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.671528 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.671434 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-workload-certs\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.671735 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.671716 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istiod-ca-cert\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.673154 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.673128 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-envoy\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.673479 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.673455 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-podinfo\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.683896 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.683870 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-token\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.685603 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.685579 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dvsk\" (UniqueName: \"kubernetes.io/projected/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-kube-api-access-9dvsk\") pod \"e2e-mt-699fd371-openshift-default-5f95689759-25j9g\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.770168 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.770082 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:24.913420 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.911158 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g"] Jul 22 02:48:24.915220 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.915167 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:48:24.915310 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.915265 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:48:24.915310 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.915296 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:48:24.948721 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:24.948681 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" event={"ID":"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915","Type":"ContainerStarted","Data":"c76a492419987db820f864932fff36a65d4296dda6d478ecfa21ebfc9c19d8a8"} Jul 22 02:48:25.956801 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:25.956765 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" event={"ID":"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915","Type":"ContainerStarted","Data":"a3988f9362a9fa3b3f55d50790c9176e16a5497bac92ae0b8dc7e5b78ad6f4fa"} Jul 22 02:48:25.994852 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:25.994802 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" podStartSLOduration=1.994784179 podStartE2EDuration="1.994784179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:48:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:48:25.992772851 +0000 UTC m=+1907.101192216" watchObservedRunningTime="2026-07-22 02:48:25.994784179 +0000 UTC m=+1907.103203594" Jul 22 02:48:26.771270 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:26.771232 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:26.776233 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:26.776209 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:26.962359 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:26.962327 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:26.963289 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:26.963271 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:38.027381 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:38.027344 2556 generic.go:356] "Generic (PLEG): container finished" podID="844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" containerID="a3988f9362a9fa3b3f55d50790c9176e16a5497bac92ae0b8dc7e5b78ad6f4fa" exitCode=0 Jul 22 02:48:38.027893 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:38.027422 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" event={"ID":"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915","Type":"ContainerDied","Data":"a3988f9362a9fa3b3f55d50790c9176e16a5497bac92ae0b8dc7e5b78ad6f4fa"} Jul 22 02:48:38.027893 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:38.027855 2556 scope.go:117] "RemoveContainer" containerID="a3988f9362a9fa3b3f55d50790c9176e16a5497bac92ae0b8dc7e5b78ad6f4fa" Jul 22 02:48:38.028868 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:38.028840 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:48:38.028935 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:38.028911 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:48:38.028973 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:38.028942 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 02:48:39.037524 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:39.037478 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" event={"ID":"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915","Type":"ContainerStarted","Data":"3d092d1643657371c602d1ca34d6fc31879030e7b643a8a353389d506ada63eb"} Jul 22 02:48:39.770804 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:39.770762 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:39.771916 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:39.771892 2556 patch_prober.go:28] interesting pod/e2e-mt-699fd371-openshift-default-5f95689759-25j9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 22 02:48:39.771978 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:39.771943 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" podUID="844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 22 02:48:40.416279 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:40.416246 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699fd371-724mw"] Jul 22 02:48:40.416660 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:40.416651 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e350cfff-1760-46ec-8b3f-dd2255c01e90" containerName="istio-proxy" Jul 22 02:48:40.418904 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:40.418889 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699fd371-724mw" Jul 22 02:48:40.422256 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:40.422211 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 02:48:40.422497 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:40.422481 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rt9zm\"" Jul 22 02:48:40.429023 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:40.429001 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699fd371-724mw"] Jul 22 02:48:40.522440 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:40.522410 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dab5b35f-1beb-4622-8508-4538f7f0aee7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-699fd371-724mw\" (UID: \"dab5b35f-1beb-4622-8508-4538f7f0aee7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699fd371-724mw" Jul 22 02:48:40.623831 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:40.623786 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dab5b35f-1beb-4622-8508-4538f7f0aee7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-699fd371-724mw\" (UID: \"dab5b35f-1beb-4622-8508-4538f7f0aee7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699fd371-724mw" Jul 22 02:48:40.624430 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:40.624407 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dab5b35f-1beb-4622-8508-4538f7f0aee7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-699fd371-724mw\" (UID: \"dab5b35f-1beb-4622-8508-4538f7f0aee7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699fd371-724mw" Jul 22 02:48:40.729666 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:40.729533 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699fd371-724mw" Jul 22 02:48:40.770986 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:40.770958 2556 patch_prober.go:28] interesting pod/e2e-mt-699fd371-openshift-default-5f95689759-25j9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 22 02:48:40.771130 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:40.771009 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" podUID="844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 22 02:48:40.905018 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:40.904988 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699fd371-724mw"] Jul 22 02:48:40.906344 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:48:40.906321 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab5b35f_1beb_4622_8508_4538f7f0aee7.slice/crio-fb8f92e45e1ac5882b2c10046d3df241291359c62ba927e262b5e9ad72582c18 WatchSource:0}: Error finding container fb8f92e45e1ac5882b2c10046d3df241291359c62ba927e262b5e9ad72582c18: Status 404 returned error can't find the container with id fb8f92e45e1ac5882b2c10046d3df241291359c62ba927e262b5e9ad72582c18 Jul 22 02:48:41.067319 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:41.067222 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699fd371-724mw" event={"ID":"dab5b35f-1beb-4622-8508-4538f7f0aee7","Type":"ContainerStarted","Data":"fb8f92e45e1ac5882b2c10046d3df241291359c62ba927e262b5e9ad72582c18"} Jul 22 02:48:41.771130 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:41.771090 2556 patch_prober.go:28] interesting pod/e2e-mt-699fd371-openshift-default-5f95689759-25j9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 22 02:48:41.771499 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:41.771146 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" podUID="844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 22 02:48:41.962888 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:41.962858 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:42.074025 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:42.073933 2556 generic.go:356] "Generic (PLEG): container finished" podID="dab5b35f-1beb-4622-8508-4538f7f0aee7" containerID="e64581e21f377cddeced4188d8c9e73d5b957ab7a7603f1485512cbcd147fb25" exitCode=0 Jul 22 02:48:42.074173 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:42.074025 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699fd371-724mw" event={"ID":"dab5b35f-1beb-4622-8508-4538f7f0aee7","Type":"ContainerDied","Data":"e64581e21f377cddeced4188d8c9e73d5b957ab7a7603f1485512cbcd147fb25"} Jul 22 02:48:42.770920 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:42.770882 2556 patch_prober.go:28] interesting pod/e2e-mt-699fd371-openshift-default-5f95689759-25j9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 22 02:48:42.771123 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:42.770951 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" podUID="844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 22 02:48:43.216141 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:43.216122 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699fd371-724mw" Jul 22 02:48:43.350428 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:43.350336 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dab5b35f-1beb-4622-8508-4538f7f0aee7-maas-api-service-ca\") pod \"dab5b35f-1beb-4622-8508-4538f7f0aee7\" (UID: \"dab5b35f-1beb-4622-8508-4538f7f0aee7\") " Jul 22 02:48:43.350743 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:43.350720 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dab5b35f-1beb-4622-8508-4538f7f0aee7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dab5b35f-1beb-4622-8508-4538f7f0aee7" (UID: "dab5b35f-1beb-4622-8508-4538f7f0aee7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:48:43.451124 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:43.451083 2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dab5b35f-1beb-4622-8508-4538f7f0aee7-maas-api-service-ca\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:48:43.774703 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:43.774672 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:43.775707 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:43.775687 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:48:44.085420 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:44.085330 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699fd371-724mw" Jul 22 02:48:44.085420 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:44.085363 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699fd371-724mw" event={"ID":"dab5b35f-1beb-4622-8508-4538f7f0aee7","Type":"ContainerDied","Data":"fb8f92e45e1ac5882b2c10046d3df241291359c62ba927e262b5e9ad72582c18"} Jul 22 02:48:44.085420 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:44.085409 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb8f92e45e1ac5882b2c10046d3df241291359c62ba927e262b5e9ad72582c18" Jul 22 02:48:55.555385 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:55.555342 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699fd371-724mw"] Jul 22 02:48:55.557488 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:55.557465 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699fd371-724mw"] Jul 22 02:48:56.254204 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:48:56.254171 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dab5b35f-1beb-4622-8508-4538f7f0aee7" path="/var/lib/kubelet/pods/dab5b35f-1beb-4622-8508-4538f7f0aee7/volumes" Jul 22 02:49:02.131932 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:02.131889 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g"] Jul 22 02:49:02.132415 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:02.132170 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" podUID="844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" containerName="istio-proxy" containerID="cri-o://3d092d1643657371c602d1ca34d6fc31879030e7b643a8a353389d506ada63eb" gracePeriod=30 Jul 22 02:49:07.393044 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.393014 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:49:07.456200 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.456160 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-credential-socket\") pod \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " Jul 22 02:49:07.456200 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.456199 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-workload-socket\") pod \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " Jul 22 02:49:07.456443 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.456222 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-token\") pod \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " Jul 22 02:49:07.456443 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.456249 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istiod-ca-cert\") pod \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " Jul 22 02:49:07.456443 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.456283 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-podinfo\") pod \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " Jul 22 02:49:07.456443 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.456302 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-envoy\") pod \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " Jul 22 02:49:07.456443 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.456340 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dvsk\" (UniqueName: \"kubernetes.io/projected/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-kube-api-access-9dvsk\") pod \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " Jul 22 02:49:07.456443 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.456368 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-workload-certs\") pod \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " Jul 22 02:49:07.456443 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.456413 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-data\") pod \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\" (UID: \"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915\") " Jul 22 02:49:07.456941 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.456472 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" (UID: "844cfdba-7abb-4bbf-96cc-e1d5b1ee4915"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:49:07.456941 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.456509 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" (UID: "844cfdba-7abb-4bbf-96cc-e1d5b1ee4915"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:49:07.456941 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.456804 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-credential-socket\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:49:07.456941 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.456823 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-workload-socket\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:49:07.456941 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.456823 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" (UID: "844cfdba-7abb-4bbf-96cc-e1d5b1ee4915"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:49:07.456941 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.456830 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" (UID: "844cfdba-7abb-4bbf-96cc-e1d5b1ee4915"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:49:07.457425 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.457399 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-data" (OuterVolumeSpecName: "istio-data") pod "844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" (UID: "844cfdba-7abb-4bbf-96cc-e1d5b1ee4915"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:49:07.458545 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.458515 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-kube-api-access-9dvsk" (OuterVolumeSpecName: "kube-api-access-9dvsk") pod "844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" (UID: "844cfdba-7abb-4bbf-96cc-e1d5b1ee4915"). InnerVolumeSpecName "kube-api-access-9dvsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:49:07.458695 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.458559 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-token" (OuterVolumeSpecName: "istio-token") pod "844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" (UID: "844cfdba-7abb-4bbf-96cc-e1d5b1ee4915"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:49:07.458986 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.458965 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" (UID: "844cfdba-7abb-4bbf-96cc-e1d5b1ee4915"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 02:49:07.459033 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.458995 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" (UID: "844cfdba-7abb-4bbf-96cc-e1d5b1ee4915"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:49:07.557445 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.557409 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-data\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:49:07.557445 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.557440 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-token\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:49:07.557445 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.557449 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istiod-ca-cert\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:49:07.557445 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.557458 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-podinfo\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:49:07.557753 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.557466 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-istio-envoy\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:49:07.557753 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.557476 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dvsk\" (UniqueName: \"kubernetes.io/projected/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-kube-api-access-9dvsk\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:49:07.557753 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:07.557485 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915-workload-certs\") on node \"ip-10-0-137-41.ec2.internal\" DevicePath \"\"" Jul 22 02:49:08.221272 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:08.221238 2556 generic.go:356] "Generic (PLEG): container finished" podID="844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" containerID="3d092d1643657371c602d1ca34d6fc31879030e7b643a8a353389d506ada63eb" exitCode=0 Jul 22 02:49:08.221430 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:08.221288 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" Jul 22 02:49:08.221430 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:08.221319 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" event={"ID":"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915","Type":"ContainerDied","Data":"3d092d1643657371c602d1ca34d6fc31879030e7b643a8a353389d506ada63eb"} Jul 22 02:49:08.221430 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:08.221414 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g" event={"ID":"844cfdba-7abb-4bbf-96cc-e1d5b1ee4915","Type":"ContainerDied","Data":"c76a492419987db820f864932fff36a65d4296dda6d478ecfa21ebfc9c19d8a8"} Jul 22 02:49:08.221613 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:08.221442 2556 scope.go:117] "RemoveContainer" containerID="3d092d1643657371c602d1ca34d6fc31879030e7b643a8a353389d506ada63eb" Jul 22 02:49:08.231589 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:08.231570 2556 scope.go:117] "RemoveContainer" containerID="a3988f9362a9fa3b3f55d50790c9176e16a5497bac92ae0b8dc7e5b78ad6f4fa" Jul 22 02:49:08.239872 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:08.239853 2556 scope.go:117] "RemoveContainer" containerID="3d092d1643657371c602d1ca34d6fc31879030e7b643a8a353389d506ada63eb" Jul 22 02:49:08.240132 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:49:08.240114 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d092d1643657371c602d1ca34d6fc31879030e7b643a8a353389d506ada63eb\": container with ID starting with 3d092d1643657371c602d1ca34d6fc31879030e7b643a8a353389d506ada63eb not found: ID does not exist" containerID="3d092d1643657371c602d1ca34d6fc31879030e7b643a8a353389d506ada63eb" Jul 22 02:49:08.240179 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:08.240141 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d092d1643657371c602d1ca34d6fc31879030e7b643a8a353389d506ada63eb"} err="failed to get container status \"3d092d1643657371c602d1ca34d6fc31879030e7b643a8a353389d506ada63eb\": rpc error: code = NotFound desc = could not find container \"3d092d1643657371c602d1ca34d6fc31879030e7b643a8a353389d506ada63eb\": container with ID starting with 3d092d1643657371c602d1ca34d6fc31879030e7b643a8a353389d506ada63eb not found: ID does not exist" Jul 22 02:49:08.240179 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:08.240158 2556 scope.go:117] "RemoveContainer" containerID="a3988f9362a9fa3b3f55d50790c9176e16a5497bac92ae0b8dc7e5b78ad6f4fa" Jul 22 02:49:08.240415 ip-10-0-137-41 kubenswrapper[2556]: E0722 02:49:08.240396 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3988f9362a9fa3b3f55d50790c9176e16a5497bac92ae0b8dc7e5b78ad6f4fa\": container with ID starting with a3988f9362a9fa3b3f55d50790c9176e16a5497bac92ae0b8dc7e5b78ad6f4fa not found: ID does not exist" containerID="a3988f9362a9fa3b3f55d50790c9176e16a5497bac92ae0b8dc7e5b78ad6f4fa" Jul 22 02:49:08.240465 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:08.240421 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3988f9362a9fa3b3f55d50790c9176e16a5497bac92ae0b8dc7e5b78ad6f4fa"} err="failed to get container status \"a3988f9362a9fa3b3f55d50790c9176e16a5497bac92ae0b8dc7e5b78ad6f4fa\": rpc error: code = NotFound desc = could not find container \"a3988f9362a9fa3b3f55d50790c9176e16a5497bac92ae0b8dc7e5b78ad6f4fa\": container with ID starting with a3988f9362a9fa3b3f55d50790c9176e16a5497bac92ae0b8dc7e5b78ad6f4fa not found: ID does not exist" Jul 22 02:49:08.247988 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:08.247963 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g"] Jul 22 02:49:08.255917 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:08.255894 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-699fd371-openshift-default-5f95689759-25j9g"] Jul 22 02:49:10.254481 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:10.254451 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" path="/var/lib/kubelet/pods/844cfdba-7abb-4bbf-96cc-e1d5b1ee4915/volumes" Jul 22 02:49:22.286202 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:22.286172 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57f477d5fd-xg8nq_a8b16709-c38a-4416-a85a-1f16c833c0cc/copy-manifests/0.log" Jul 22 02:49:22.293065 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:22.293038 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57f477d5fd-xg8nq_a8b16709-c38a-4416-a85a-1f16c833c0cc/manager/0.log" Jul 22 02:49:22.735905 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:22.735877 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744790-27xlc_aafddb28-2ba3-4afe-9d50-cd141e00c5b7/cleanup/0.log" Jul 22 02:49:22.846083 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:22.846054 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744805-2csrn_37bfabd4-e8e3-4cc9-a14b-5d2f3b4bb6d1/cleanup/0.log" Jul 22 02:49:23.758340 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:23.758314 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m_869a4831-c73d-413b-94d1-f06ed4c19b23/util/0.log" Jul 22 02:49:23.768865 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:23.768841 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m_869a4831-c73d-413b-94d1-f06ed4c19b23/pull/0.log" Jul 22 02:49:23.775101 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:23.775081 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m_869a4831-c73d-413b-94d1-f06ed4c19b23/extract/0.log" Jul 22 02:49:23.887985 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:23.887958 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf_e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7/util/0.log" Jul 22 02:49:23.894438 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:23.894408 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf_e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7/pull/0.log" Jul 22 02:49:23.900596 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:23.900578 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf_e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7/extract/0.log" Jul 22 02:49:24.010819 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:24.010748 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn_409f3291-97e8-4cd9-8e3a-20d37af25b62/util/0.log" Jul 22 02:49:24.016844 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:24.016825 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn_409f3291-97e8-4cd9-8e3a-20d37af25b62/pull/0.log" Jul 22 02:49:24.022997 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:24.022981 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn_409f3291-97e8-4cd9-8e3a-20d37af25b62/extract/0.log" Jul 22 02:49:24.149474 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:24.149447 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd_f9e2a6a0-502e-4149-bd20-e63882835f24/util/0.log" Jul 22 02:49:24.166330 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:24.166307 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd_f9e2a6a0-502e-4149-bd20-e63882835f24/pull/0.log" Jul 22 02:49:24.190253 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:24.190234 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd_f9e2a6a0-502e-4149-bd20-e63882835f24/extract/0.log" Jul 22 02:49:25.476026 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:25.475998 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4kxssl_2a210b64-0b49-4c52-a35c-622b7e3fa062/istio-proxy/0.log" Jul 22 02:49:25.603760 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:25.603723 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wxkbs_04628628-c241-4318-b2cf-5054b3be506a/discovery/0.log" Jul 22 02:49:25.968989 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:25.968962 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-whzck_e35f816c-eba3-47ae-a9aa-a18ae53c426f/istio-proxy/1.log" Jul 22 02:49:26.090496 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:26.090470 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-vcbtq_d5458b09-d09b-4ca7-aded-e3b09516d9b7/payload-pre-processing/0.log" Jul 22 02:49:26.694365 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:26.694332 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-zk9p8_58068ab8-84c5-40c7-a8cf-9b808e6b9b58/main/0.log" Jul 22 02:49:32.325172 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.325097 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j9wvl/must-gather-xgmj2"] Jul 22 02:49:32.325600 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.325456 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dab5b35f-1beb-4622-8508-4538f7f0aee7" containerName="revoke-keys" Jul 22 02:49:32.325600 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.325468 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="dab5b35f-1beb-4622-8508-4538f7f0aee7" containerName="revoke-keys" Jul 22 02:49:32.325600 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.325504 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" containerName="istio-proxy" Jul 22 02:49:32.325600 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.325510 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" containerName="istio-proxy" Jul 22 02:49:32.325600 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.325517 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" containerName="istio-proxy" Jul 22 02:49:32.325600 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.325523 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" containerName="istio-proxy" Jul 22 02:49:32.325600 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.325573 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" containerName="istio-proxy" Jul 22 02:49:32.325600 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.325581 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="844cfdba-7abb-4bbf-96cc-e1d5b1ee4915" containerName="istio-proxy" Jul 22 02:49:32.325600 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.325588 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="dab5b35f-1beb-4622-8508-4538f7f0aee7" containerName="revoke-keys" Jul 22 02:49:32.328789 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.328772 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j9wvl/must-gather-xgmj2" Jul 22 02:49:32.331485 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.331460 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j9wvl\"/\"default-dockercfg-sp5qx\"" Jul 22 02:49:32.332759 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.332741 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j9wvl\"/\"kube-root-ca.crt\"" Jul 22 02:49:32.332868 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.332790 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j9wvl\"/\"openshift-service-ca.crt\"" Jul 22 02:49:32.338070 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.338042 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j9wvl/must-gather-xgmj2"] Jul 22 02:49:32.479918 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.479877 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1a7822dd-f680-4aea-b36e-8a2c5242ad84-must-gather-output\") pod \"must-gather-xgmj2\" (UID: \"1a7822dd-f680-4aea-b36e-8a2c5242ad84\") " pod="openshift-must-gather-j9wvl/must-gather-xgmj2" Jul 22 02:49:32.480103 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.479952 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-267np\" (UniqueName: \"kubernetes.io/projected/1a7822dd-f680-4aea-b36e-8a2c5242ad84-kube-api-access-267np\") pod \"must-gather-xgmj2\" (UID: \"1a7822dd-f680-4aea-b36e-8a2c5242ad84\") " pod="openshift-must-gather-j9wvl/must-gather-xgmj2" Jul 22 02:49:32.581139 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.581046 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1a7822dd-f680-4aea-b36e-8a2c5242ad84-must-gather-output\") pod \"must-gather-xgmj2\" (UID: \"1a7822dd-f680-4aea-b36e-8a2c5242ad84\") " pod="openshift-must-gather-j9wvl/must-gather-xgmj2" Jul 22 02:49:32.581139 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.581128 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-267np\" (UniqueName: \"kubernetes.io/projected/1a7822dd-f680-4aea-b36e-8a2c5242ad84-kube-api-access-267np\") pod \"must-gather-xgmj2\" (UID: \"1a7822dd-f680-4aea-b36e-8a2c5242ad84\") " pod="openshift-must-gather-j9wvl/must-gather-xgmj2" Jul 22 02:49:32.581432 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.581409 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1a7822dd-f680-4aea-b36e-8a2c5242ad84-must-gather-output\") pod \"must-gather-xgmj2\" (UID: \"1a7822dd-f680-4aea-b36e-8a2c5242ad84\") " pod="openshift-must-gather-j9wvl/must-gather-xgmj2" Jul 22 02:49:32.591585 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.591555 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-267np\" (UniqueName: \"kubernetes.io/projected/1a7822dd-f680-4aea-b36e-8a2c5242ad84-kube-api-access-267np\") pod \"must-gather-xgmj2\" (UID: \"1a7822dd-f680-4aea-b36e-8a2c5242ad84\") " pod="openshift-must-gather-j9wvl/must-gather-xgmj2" Jul 22 02:49:32.638682 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.638624 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j9wvl/must-gather-xgmj2" Jul 22 02:49:32.793164 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.793135 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j9wvl/must-gather-xgmj2"] Jul 22 02:49:32.793610 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:49:32.793580 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a7822dd_f680_4aea_b36e_8a2c5242ad84.slice/crio-a7034f82d44c23649737acb1b800a91f1f450da204dfb74b57231b77d72c9787 WatchSource:0}: Error finding container a7034f82d44c23649737acb1b800a91f1f450da204dfb74b57231b77d72c9787: Status 404 returned error can't find the container with id a7034f82d44c23649737acb1b800a91f1f450da204dfb74b57231b77d72c9787 Jul 22 02:49:32.795652 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:32.795618 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 02:49:33.357975 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:33.357943 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j9wvl/must-gather-xgmj2" event={"ID":"1a7822dd-f680-4aea-b36e-8a2c5242ad84","Type":"ContainerStarted","Data":"a7034f82d44c23649737acb1b800a91f1f450da204dfb74b57231b77d72c9787"} Jul 22 02:49:34.366825 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:34.366775 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j9wvl/must-gather-xgmj2" event={"ID":"1a7822dd-f680-4aea-b36e-8a2c5242ad84","Type":"ContainerStarted","Data":"74df75df1b7369914325166697d0e1ddfb19155038dd102bdf7c59ed1d01f75d"} Jul 22 02:49:34.366825 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:34.366831 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j9wvl/must-gather-xgmj2" event={"ID":"1a7822dd-f680-4aea-b36e-8a2c5242ad84","Type":"ContainerStarted","Data":"4c193c56a02f40d244b38d9346d2fe76c718024f6d14a440ca2495d48bf80265"} Jul 22 02:49:34.388298 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:34.388219 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j9wvl/must-gather-xgmj2" podStartSLOduration=1.518931368 podStartE2EDuration="2.388181485s" totalImagesPullingTime="869.250117ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:49:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:49:34.386083386 +0000 UTC m=+1975.494502723" watchObservedRunningTime="2026-07-22 02:49:34.388181485 +0000 UTC m=+1975.496600822" Jul 22 02:49:35.267729 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:35.267699 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rxh5h_7f8aa8dc-6c8f-4e21-84be-429e861b5fa0/global-pull-secret-syncer/0.log" Jul 22 02:49:35.398453 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:35.398421 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pqx7f_241b6cf2-254d-4233-8d0a-0b373bd1236d/konnectivity-agent/0.log" Jul 22 02:49:35.504039 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:35.504015 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-41.ec2.internal_0a2b0b0078cc79ecb5329ccfa51d0dad/haproxy/0.log" Jul 22 02:49:39.886435 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:39.886406 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m_869a4831-c73d-413b-94d1-f06ed4c19b23/extract/0.log" Jul 22 02:49:39.936909 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:39.936843 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m_869a4831-c73d-413b-94d1-f06ed4c19b23/util/0.log" Jul 22 02:49:39.988966 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:39.988933 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zwk8m_869a4831-c73d-413b-94d1-f06ed4c19b23/pull/0.log" Jul 22 02:49:40.054556 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:40.054527 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf_e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7/extract/0.log" Jul 22 02:49:40.107733 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:40.107566 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf_e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7/util/0.log" Jul 22 02:49:40.163530 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:40.163499 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ntflf_e89a4ec6-6698-4f5a-b9ee-8419ec85fdf7/pull/0.log" Jul 22 02:49:40.233079 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:40.233044 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn_409f3291-97e8-4cd9-8e3a-20d37af25b62/extract/0.log" Jul 22 02:49:40.293126 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:40.293102 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn_409f3291-97e8-4cd9-8e3a-20d37af25b62/util/0.log" Jul 22 02:49:40.363866 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:40.363790 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735fskn_409f3291-97e8-4cd9-8e3a-20d37af25b62/pull/0.log" Jul 22 02:49:40.417267 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:40.417126 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd_f9e2a6a0-502e-4149-bd20-e63882835f24/extract/0.log" Jul 22 02:49:40.466002 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:40.465975 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd_f9e2a6a0-502e-4149-bd20-e63882835f24/util/0.log" Jul 22 02:49:40.526736 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:40.526705 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12w2dd_f9e2a6a0-502e-4149-bd20-e63882835f24/pull/0.log" Jul 22 02:49:43.198233 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:43.198179 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_36536c18-c4ca-4929-b7fb-f8dea04daf42/alertmanager/0.log" Jul 22 02:49:43.227005 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:43.226958 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_36536c18-c4ca-4929-b7fb-f8dea04daf42/config-reloader/0.log" Jul 22 02:49:43.255760 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:43.255727 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_36536c18-c4ca-4929-b7fb-f8dea04daf42/kube-rbac-proxy-web/0.log" Jul 22 02:49:43.294869 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:43.294835 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_36536c18-c4ca-4929-b7fb-f8dea04daf42/kube-rbac-proxy/0.log" Jul 22 02:49:43.332363 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:43.332327 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_36536c18-c4ca-4929-b7fb-f8dea04daf42/kube-rbac-proxy-metric/0.log" Jul 22 02:49:43.363267 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:43.363241 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_36536c18-c4ca-4929-b7fb-f8dea04daf42/prom-label-proxy/0.log" Jul 22 02:49:43.399461 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:43.399408 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_36536c18-c4ca-4929-b7fb-f8dea04daf42/init-config-reloader/0.log" Jul 22 02:49:44.002911 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:44.002866 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-86mnr_64c1cf9e-1333-452a-9658-28e622ebccb6/node-exporter/0.log" Jul 22 02:49:44.031151 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:44.031124 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-86mnr_64c1cf9e-1333-452a-9658-28e622ebccb6/kube-rbac-proxy/0.log" Jul 22 02:49:44.062192 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:44.062166 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-86mnr_64c1cf9e-1333-452a-9658-28e622ebccb6/init-textfile/0.log" Jul 22 02:49:44.626215 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:44.626187 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7fb65d574b-pr886_688c4876-7068-4755-a76d-0a8d802e5710/telemeter-client/0.log" Jul 22 02:49:44.653463 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:44.653440 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7fb65d574b-pr886_688c4876-7068-4755-a76d-0a8d802e5710/reload/0.log" Jul 22 02:49:44.680313 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:44.680283 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7fb65d574b-pr886_688c4876-7068-4755-a76d-0a8d802e5710/kube-rbac-proxy/0.log" Jul 22 02:49:44.710465 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:44.710441 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5db95b4bd5-pz54b_93114ff8-1fc9-48a8-9462-67a0b8bea4f0/thanos-query/0.log" Jul 22 02:49:44.736206 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:44.736174 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5db95b4bd5-pz54b_93114ff8-1fc9-48a8-9462-67a0b8bea4f0/kube-rbac-proxy-web/0.log" Jul 22 02:49:44.768496 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:44.768467 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5db95b4bd5-pz54b_93114ff8-1fc9-48a8-9462-67a0b8bea4f0/kube-rbac-proxy/0.log" Jul 22 02:49:44.795125 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:44.795094 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5db95b4bd5-pz54b_93114ff8-1fc9-48a8-9462-67a0b8bea4f0/prom-label-proxy/0.log" Jul 22 02:49:44.829092 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:44.829058 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5db95b4bd5-pz54b_93114ff8-1fc9-48a8-9462-67a0b8bea4f0/kube-rbac-proxy-rules/0.log" Jul 22 02:49:44.854804 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:44.854778 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5db95b4bd5-pz54b_93114ff8-1fc9-48a8-9462-67a0b8bea4f0/kube-rbac-proxy-metrics/0.log" Jul 22 02:49:44.977512 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:44.977476 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf"] Jul 22 02:49:44.982118 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:44.982089 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" Jul 22 02:49:44.992055 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:44.992031 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf"] Jul 22 02:49:45.118489 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:45.117588 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c7b79dbb-950d-4b57-984c-b55c29caf440-podres\") pod \"perf-node-gather-daemonset-p65hf\" (UID: \"c7b79dbb-950d-4b57-984c-b55c29caf440\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" Jul 22 02:49:45.118489 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:45.117698 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7b79dbb-950d-4b57-984c-b55c29caf440-lib-modules\") pod \"perf-node-gather-daemonset-p65hf\" (UID: \"c7b79dbb-950d-4b57-984c-b55c29caf440\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" Jul 22 02:49:45.118489 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:45.117778 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh9hm\" (UniqueName: \"kubernetes.io/projected/c7b79dbb-950d-4b57-984c-b55c29caf440-kube-api-access-gh9hm\") pod \"perf-node-gather-daemonset-p65hf\" (UID: \"c7b79dbb-950d-4b57-984c-b55c29caf440\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" Jul 22 02:49:45.118489 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:45.117809 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c7b79dbb-950d-4b57-984c-b55c29caf440-proc\") pod \"perf-node-gather-daemonset-p65hf\" (UID: \"c7b79dbb-950d-4b57-984c-b55c29caf440\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" Jul 22 02:49:45.118489 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:45.117850 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7b79dbb-950d-4b57-984c-b55c29caf440-sys\") pod \"perf-node-gather-daemonset-p65hf\" (UID: \"c7b79dbb-950d-4b57-984c-b55c29caf440\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" Jul 22 02:49:45.219289 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:45.219218 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh9hm\" (UniqueName: \"kubernetes.io/projected/c7b79dbb-950d-4b57-984c-b55c29caf440-kube-api-access-gh9hm\") pod \"perf-node-gather-daemonset-p65hf\" (UID: \"c7b79dbb-950d-4b57-984c-b55c29caf440\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" Jul 22 02:49:45.219289 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:45.219286 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c7b79dbb-950d-4b57-984c-b55c29caf440-proc\") pod \"perf-node-gather-daemonset-p65hf\" (UID: \"c7b79dbb-950d-4b57-984c-b55c29caf440\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" Jul 22 02:49:45.219550 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:45.219323 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7b79dbb-950d-4b57-984c-b55c29caf440-sys\") pod \"perf-node-gather-daemonset-p65hf\" (UID: \"c7b79dbb-950d-4b57-984c-b55c29caf440\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" Jul 22 02:49:45.219550 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:45.219358 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c7b79dbb-950d-4b57-984c-b55c29caf440-podres\") pod \"perf-node-gather-daemonset-p65hf\" (UID: \"c7b79dbb-950d-4b57-984c-b55c29caf440\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" Jul 22 02:49:45.219550 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:45.219427 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7b79dbb-950d-4b57-984c-b55c29caf440-lib-modules\") pod \"perf-node-gather-daemonset-p65hf\" (UID: \"c7b79dbb-950d-4b57-984c-b55c29caf440\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" Jul 22 02:49:45.219550 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:45.219485 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7b79dbb-950d-4b57-984c-b55c29caf440-sys\") pod \"perf-node-gather-daemonset-p65hf\" (UID: \"c7b79dbb-950d-4b57-984c-b55c29caf440\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" Jul 22 02:49:45.219757 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:45.219613 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c7b79dbb-950d-4b57-984c-b55c29caf440-podres\") pod \"perf-node-gather-daemonset-p65hf\" (UID: \"c7b79dbb-950d-4b57-984c-b55c29caf440\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" Jul 22 02:49:45.219757 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:45.219613 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7b79dbb-950d-4b57-984c-b55c29caf440-lib-modules\") pod \"perf-node-gather-daemonset-p65hf\" (UID: \"c7b79dbb-950d-4b57-984c-b55c29caf440\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" Jul 22 02:49:45.219757 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:45.219689 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c7b79dbb-950d-4b57-984c-b55c29caf440-proc\") pod \"perf-node-gather-daemonset-p65hf\" (UID: \"c7b79dbb-950d-4b57-984c-b55c29caf440\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" Jul 22 02:49:45.228548 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:45.228450 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh9hm\" (UniqueName: \"kubernetes.io/projected/c7b79dbb-950d-4b57-984c-b55c29caf440-kube-api-access-gh9hm\") pod \"perf-node-gather-daemonset-p65hf\" (UID: \"c7b79dbb-950d-4b57-984c-b55c29caf440\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" Jul 22 02:49:45.296902 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:45.296868 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" Jul 22 02:49:45.482296 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:45.482269 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf"] Jul 22 02:49:45.488463 ip-10-0-137-41 kubenswrapper[2556]: W0722 02:49:45.484786 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc7b79dbb_950d_4b57_984c_b55c29caf440.slice/crio-b2d8e2253b3a12febbe42de1e0b35f7395d0ce5a26cebb3e813891264d95789e WatchSource:0}: Error finding container b2d8e2253b3a12febbe42de1e0b35f7395d0ce5a26cebb3e813891264d95789e: Status 404 returned error can't find the container with id b2d8e2253b3a12febbe42de1e0b35f7395d0ce5a26cebb3e813891264d95789e Jul 22 02:49:46.504883 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:46.504834 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" event={"ID":"c7b79dbb-950d-4b57-984c-b55c29caf440","Type":"ContainerStarted","Data":"f89637be51c8afd7995910ac549b08bfc9d0869a82f073638ef93ea2a6e31bc8"} Jul 22 02:49:46.505364 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:46.504937 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" event={"ID":"c7b79dbb-950d-4b57-984c-b55c29caf440","Type":"ContainerStarted","Data":"b2d8e2253b3a12febbe42de1e0b35f7395d0ce5a26cebb3e813891264d95789e"} Jul 22 02:49:46.505796 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:46.505772 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" Jul 22 02:49:46.524722 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:46.524622 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" podStartSLOduration=2.524606741 podStartE2EDuration="2.524606741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:49:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:49:46.523281765 +0000 UTC m=+1987.631701122" watchObservedRunningTime="2026-07-22 02:49:46.524606741 +0000 UTC m=+1987.633026074" Jul 22 02:49:47.087451 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:47.087420 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-97cf44bf9-nc24q_6c71f027-4f3f-418d-b644-0d513923c76c/console/0.log" Jul 22 02:49:48.809512 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:48.809449 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c7prs_2ee339cc-7398-4a73-bb10-205286f33a42/dns/0.log" Jul 22 02:49:48.836890 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:48.836864 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c7prs_2ee339cc-7398-4a73-bb10-205286f33a42/kube-rbac-proxy/0.log" Jul 22 02:49:48.924267 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:48.924232 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5bgxb_74e8d4ad-5d63-4e10-b2fd-1f09c1bd2365/dns-node-resolver/0.log" Jul 22 02:49:49.503890 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:49.503860 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6454596bcc-pv7r7_96d1ad8a-bfeb-401a-9734-ad3aeda4668f/registry/0.log" Jul 22 02:49:49.552752 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:49.552723 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9r7nk_19b441a9-443f-4cac-8a30-d9fd5e4a4cca/node-ca/0.log" Jul 22 02:49:50.524198 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:50.524166 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4kxssl_2a210b64-0b49-4c52-a35c-622b7e3fa062/istio-proxy/0.log" Jul 22 02:49:50.621189 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:50.621158 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wxkbs_04628628-c241-4318-b2cf-5054b3be506a/discovery/0.log" Jul 22 02:49:50.711349 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:50.711321 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-whzck_e35f816c-eba3-47ae-a9aa-a18ae53c426f/istio-proxy/0.log" Jul 22 02:49:50.745138 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:50.745110 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-whzck_e35f816c-eba3-47ae-a9aa-a18ae53c426f/istio-proxy/1.log" Jul 22 02:49:50.778582 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:50.778501 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-vcbtq_d5458b09-d09b-4ca7-aded-e3b09516d9b7/payload-pre-processing/0.log" Jul 22 02:49:51.450853 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:51.450823 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2lcb6_17f9eb80-402d-400a-a3a8-92188048c547/serve-healthcheck-canary/0.log" Jul 22 02:49:52.077466 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:52.077440 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lh48z_5e66d38b-512a-49c6-ab30-ba61bf4a294d/kube-rbac-proxy/0.log" Jul 22 02:49:52.106898 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:52.106870 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lh48z_5e66d38b-512a-49c6-ab30-ba61bf4a294d/exporter/0.log" Jul 22 02:49:52.128652 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:52.128617 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lh48z_5e66d38b-512a-49c6-ab30-ba61bf4a294d/extractor/0.log" Jul 22 02:49:53.532517 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:53.532491 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-p65hf" Jul 22 02:49:55.155970 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:55.155909 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57f477d5fd-xg8nq_a8b16709-c38a-4416-a85a-1f16c833c0cc/manager/0.log" Jul 22 02:49:55.181175 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:55.181038 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57f477d5fd-xg8nq_a8b16709-c38a-4416-a85a-1f16c833c0cc/copy-manifests/0.log" Jul 22 02:49:55.483080 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:55.483049 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4kxssl_2a210b64-0b49-4c52-a35c-622b7e3fa062/istio-proxy/0.log" Jul 22 02:49:55.566244 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:55.566207 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wxkbs_04628628-c241-4318-b2cf-5054b3be506a/discovery/0.log" Jul 22 02:49:55.636281 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:55.635553 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-whzck_e35f816c-eba3-47ae-a9aa-a18ae53c426f/istio-proxy/0.log" Jul 22 02:49:55.671322 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:55.671286 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-whzck_e35f816c-eba3-47ae-a9aa-a18ae53c426f/istio-proxy/1.log" Jul 22 02:49:55.704945 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:55.704909 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-vcbtq_d5458b09-d09b-4ca7-aded-e3b09516d9b7/payload-pre-processing/0.log" Jul 22 02:49:56.565146 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:56.565070 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c9bd579-nktzh_04406e8d-ad67-47c3-99f0-5c0c58ff32bb/manager/0.log" Jul 22 02:49:56.594463 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:56.594426 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-vwk8j_6404fddf-2f86-4fd8-b68a-264305a71e5c/openshift-lws-operator/0.log" Jul 22 02:49:56.935428 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:56.935395 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4kxssl_2a210b64-0b49-4c52-a35c-622b7e3fa062/istio-proxy/0.log" Jul 22 02:49:57.017073 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:57.017035 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wxkbs_04628628-c241-4318-b2cf-5054b3be506a/discovery/0.log" Jul 22 02:49:57.073611 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:57.073578 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-whzck_e35f816c-eba3-47ae-a9aa-a18ae53c426f/istio-proxy/0.log" Jul 22 02:49:57.105053 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:57.105010 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-whzck_e35f816c-eba3-47ae-a9aa-a18ae53c426f/istio-proxy/1.log" Jul 22 02:49:57.140303 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:49:57.140271 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-vcbtq_d5458b09-d09b-4ca7-aded-e3b09516d9b7/payload-pre-processing/0.log" Jul 22 02:50:02.940263 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:50:02.940236 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2wwsz_6ee4b230-9857-4cb9-a2d3-9c1ea34ff730/kube-multus/0.log" Jul 22 02:50:03.163118 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:50:03.163033 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnvr9_88ba46ca-7b85-49ff-a952-f5e94af52408/kube-multus-additional-cni-plugins/0.log" Jul 22 02:50:03.189632 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:50:03.189605 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnvr9_88ba46ca-7b85-49ff-a952-f5e94af52408/egress-router-binary-copy/0.log" Jul 22 02:50:03.215943 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:50:03.215907 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnvr9_88ba46ca-7b85-49ff-a952-f5e94af52408/cni-plugins/0.log" Jul 22 02:50:03.245697 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:50:03.245665 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnvr9_88ba46ca-7b85-49ff-a952-f5e94af52408/bond-cni-plugin/0.log" Jul 22 02:50:03.269963 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:50:03.269933 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnvr9_88ba46ca-7b85-49ff-a952-f5e94af52408/routeoverride-cni/0.log" Jul 22 02:50:03.295146 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:50:03.295118 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnvr9_88ba46ca-7b85-49ff-a952-f5e94af52408/whereabouts-cni-bincopy/0.log" Jul 22 02:50:03.319932 ip-10-0-137-41 kubenswrapper[2556]: I0722 02:50:03.319891 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnvr9_88ba46ca-7b85-49ff-a952-f5e94af52408/whereabouts-cni/0.log"